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The First Ten Years of the Transistor 


A Guest Editorial | 
By W. 0. BAKER 


The technology in which it was to be used was already about 35 years 
old when Bardeen, Brattain and Shockley discovered the transistor ten 
years ago. This circumstance has led to an unusual course of develop- 
ment and application. The transistor has affected the technical and com- 
mercial growth of electronics and communications more quickly than 
might have been expected from the somewhat offhand newspaper com- 
ments of July 1, 1948. (The news story about the transistor was carried 
on page 46 in one famous case). 

The quick growth of the transistor art after the original discovery 
came about because electronics based on an elaborate functionality of 
the vacuum tube as amplifier, modulator, oscillator and such in our 
technology was already preeminent. The transistor provided an alterna- 
tive to the vacuum tube in these functions, so electrotechnology, one of 
the most elegant intellectual attainments of history, was ready for any 
and all transistors. 

‘This was as though Faraday’s capacitors and dielectric principles had 
been first reported to a meeting of the A. I. E. E., or antibiotics had been 
announced in finished form to a congress of bacteriologists and clinicians 
who had already established therapeutic procedures for dealing with all 
classes of germs. Actually, electrical capacitors, inductors, resistors and 
thermionics were extensively explored before any uses were known for 
them; bacterial inhibition by antibiotics was studied for decades before © 
medical application was worked out; even with war-time haste, several 
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years of intensive effort separated Hahn and Strassmann’s discovery of 
nuclear fission from the production of significant energy by the process. 
Thus, in each of these cases there was time to ponder, to try, but most of 
all to imagine, beyond any known framework of use, what the discovery 
would come to. 

Much of this was denied the transistor in its early years. To a degree, 
perspective was lost in the astoundingly rapid exploitation of transistor 
function. In late 1952 there were commercial transistorized hearing aids. 
Their performance now surpasses Dr. Bell’s highest hopes for comfort for 
the deaf. About 100,000 transistors for defense use studies were made the 
same year. Three million were made annually for auto radios by 1957, 
in the United States alone. The cost of this being a child prodigy, of this 
growing old in infancy, was early made clear by crises in reliability. An 
article in Time for September 7, 1953, said, “Still neither... nor other 
scientists have lost all hope concerning the difficulties then widespread 
in production and performance of the device.” Satisfactory yields from 
production have been erratic, and economics consequently often frenzied. 

But other costs may have been far greater, costs incurred because the 
world of electronics foolishly thought it knew all about the possible uses 
and the possible consequences of the transistor through experience gained 
long before the transistor was created. Because of this, we must at the 
end of this first decade give thought to what the discovery of the transis- 
tor means in a larger frame of reference than that even all of the present 
wonders of electrotechnology—communications, automation, control— 
can give it. 

The transistor discovery has in many ways altered our age-old ideas 
about the electrical behavior of matter. For example, we are accustomed 
to the idea that positive and negative charges of electricity accessible to 
each other will amost immediately neutralize one another, and that com- 
mon fluid media, for example, contain charged particles of opposite sign 
only because of stabilization as ions and the continuing replenishment of 
the supply by thermal agitation. In the crystals of which transistors are 
made, however, positive and negative charges do coexist for appreciable 
times in both the so-called p and n regions. Thus, p-type crystals having 
a multitude of positive charges contained in their rigid atomic skeleton 
also have electrons ‘free’ among them. Such long-life times of opposite 
charges for recombination suggest an abundance of new effects, in addi- 
tion to transistor action across junctions. For instance, the controlled 
recombination can give light emission which may itself some day be 
useful, and which already has revealed much about electrical charge in- 
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teractions. The conductivity modulation of semiconductors contrasts 
them with metals. 

Further, and equally exciting, are the phenomena related to the 
mobility of the charged particles. We find that, although the condi- 
tions for this new control of electric charges are indeed built firmly into 
the crystal lattice by the substitution of foreign atoms, a remarkable 
mobility of charge remains. Thus, responses of these systems to electro- 
magnetic waves are lively. 

Significantly, this liveliness is different from the acceleration of elec- 
trons in the vacuum tube, which is proportional to an electric field, and 
it is also different from the behavior of the electron cloud conceived to 
be in metals. For instance, in the crystals preferred for transistors, elec- 
trons move at about 1/1000th the speed of light and hit some atom and 
bounce off in a way that corresponds to a new motion in each distance of 
about 1000 atom diameters. They can keep this spirited pace over such 
long distances because of the perfect periodic arrangement of atoms in 
the crystal. Through such an array of atoms, electrons can proceed like 
waves, as Davisson and Germer discovered at Bell Telephone Labora- 
tories more than 25 years ago. These electron movements are such that 
the speed and not the acceleration is proportional to the applied electric 
field. A pressing challenge now is discovery of some principle which will 
give us other ways of controlling this speed and thus, in effect, raise 
the frequency response of transistors from a few hundred megacycles 
up to thousands and tens of thousands. Existing knowledge seems in- 
adequate. 

The second main aspect of the transistor discovery which is influencing 
nearly all modern science and technology of solids is the novel forms of 
matter it evoked. Pfann’s zone refining produced germanium and silicon 
crystals of such purity and relative perfection that the ideal simplicity of 
solid state theory was at last approximated. It can, in fact, be argued 
that silicon and germanium are the best understood solids. At least they 
were understood perfectly enough so that, in them, imperfections (in 
crystal order) were first identified. Thus a mystery as old as science and 
as crystals was exposed. It is because of such imperfections that the 
strength of metals and solid matter is generally so much less for both 
yield and fracture than the forces between the atoms of the ideal crystals 
would allow. The explanation is, as long guessed but not before shown, 
that wires and girders and bridges and wheels have to be the extra size 
they are because the atoms are missing from some places they ought to 
be in; that is, dislocations and vacancies limit the properties of real 
solids. 
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Such meaningful findings as these coupled directly back to the transis- 
tor technology itself, since imperfections control directly certain per- 
formance of the devices. This all shows what a few new ideas can mean 
to the entirety of science and engineering. 

Likewise, of course, these exquisite refinements in the knowledge of 
what electrons and their positive equivalents or “holes” could do in 
suitable crystals have engendered new families of devices, of deep import 
for the future. Thus, in the past decade, have been created junction 
devices yielding nearly perfect rectifiers, electronic switches, photo 
and solar cells and lightning protectors or nondestructive fuses. In- 
deed, such controlled breakdown has been made to give out visible 
light associated with microplasmas, with implications for visual com- 
munication which are just now being pondered. 

These aspects of the transistor discovery have fired the imaginations 
of engineers and scientists throughout the world. While substitution for 
the vacuum tube has itself attracted many licensees of patents through 
the Western Electric Company, including agreements in England, 
France, Germany, Switzerland, Sweden, Italy, the Netherlands, Japan, 
as well as North America, the recognition also of additional features is 
seen in the accompanying active and historic exchange of technical in- 
formation, which is growing rapidly. Thus, beginning with a couple of 
international symposia early held at Bell Telephone Laboratories, there 
has now arisen a vigorous worldwide system of conferences in this new 
field. This may be illustrated by the Solid State School held at Varenna 
on Lake Como, Italy, in 1957, the International Conference on Solid State 
Physics in Electronics and Telecommunications in Brussels in 1958, and 
the forthcoming International Conference at Rochester. One should also 
mention the formation of a new division of solid state physics of the 
American Physical Society which provided 18 of 24 sessions at the Chi- 
cago meeting of the Society in March of 1958. Publication has been 
equally strong evidence that the transistor has had a bearing on modern. 
science far beyond that of a specific electronic device. Several thousand 
papers have now been published in journals all around the world, includ- 
ing the Indian Journal of Physics, the Czech Slaboproudy Obzor and the 
Russian Uspekhi Fizicheskikh Nauk. 

The results of this world-wide interest and attention have in ten years, 
as in the case of transistor technology, spread transistor science far be- 
yond its original scope. Thus the most perfect solids, the nearly ideal 
crystals, have enabled qualities of separate electrons rather than charac- 
teristics of electron swarms to be studied and eventually to be exploited. 
Paramagnetic systems arise from the unpaired electron spins in ger- 
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manium and silicon crystals containing certain well-known donor atoms. 
These exhibit resonance of the thermal motion of the isolated magnetic 
electrons with radio frequency or microwave frequency fields, in the 
presence of an external magnetic bias. A great new realm of behavior of 
electric waves has been revealed. This is in their interaction with electron 
spins in which energy, and hence signals, can be exchanged among 
waves and crystals not by the movement of electric charges, but by the 
reorientation of the magnetic moments of electrons. These may be dis- 
tributed in nonconductors easily accessible to the penetration of even 
microwaves and, of course, this realm extends far beyond semiconduc- 
tors. Solid state MASERS, as some of the devices embodying these prin- 
ciples have come to be called, promise a new freedom from noise in 
electronic amplifiers, so that signals from outer space, and indeed 
the signals from the stars which radio astronomers study, will be ex- 
actly received. Further, the international scientific interest in both the 
concept and the compositions of transistors has recently succeeded in 
identifying, by the methods of cyclotron resonance, that electronic 
charge carriers, the essence of all communications and electrical engineer- 
ing, can exhibit even in metal systems more than one effective mass. 
This means that knowledge of conductors is being sharply revised and 
extended, since details of the band structure concept are being revealed 
in formerly unimagined detail. This study has indeed finally illuminated 
the detailed structure of graphitic carbon—the patriarch of electronics— 
in filaments, microphones, resistors, electrodes and contacts. 

But finally, what does all this replacement of the vacuum tube at one 
end and advancement of the frontiers of science at the other during the 
decade of the transistor mean for communications itself? Any comment, 
and especially any comment looking to the future, ought to be related 
to the shape and philosophy of electrical communications expected to 
come. Therewith a certain harmony in time appears, because this is also 
the tenth anniversary of Shannon’s Mathematical Theory of Communica- 
tion and of Wiener’s Cybernetics, as well as the 30th anniversary of 
Hartley’s forerunner of modern analysis of the communication of in- 
formation. Shannon’s monumental theory is particularly rich in its ap- 
plications to situations involving discrete coding, as in the so-called 
“digitalization”’ of sight and sound. That is, instead of using electro- 
magnetic waves whose amplitude or frequency are analogues to acoustic 
or visual signals, these same signals are represented by pulses, giving on- 
or-off, 1-or-0 conditions. Such pulse systems are particularly suited to 
modern wideband transmission media. 

The transistor and its associated devices are perfectly proportioned 
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for communications and data handling, for control and sensing, based 
on pulses. The pulse code modulation now developed for exchange trunk 
carrier in telephony seems destined also for widespread video transmis- 
sion by sending 70 million pulses per second. This now seems possible 
over ordinary pairs of wires, providing that simple transistor amplifiers 
are frequently inserted in the lines. Important new uses of existing plant 
facilities may soon appear. But a still greater unity of communications 
systems based on binary signal processes is forthcoming. Switching and 
the related logical elements of computing comprise extensive digital op- 
erations. While most of the work here may be well done by improved 
diodes, which came along with transistor technology, the transistors 
themselves are, as in transmission, elegantly suited for the amplifiers, 
inverters, pulse stretchers, power regulators and tone generators neces- 
sary in the new schemes of communications, in which at last the technical 
essences of transmission and switching are joined. 

Junction devices seem uniquely suitable for digital operations; on- 
or-off, plus-or-minus now look like the alphabets of communication— 
through neurons, minds, telegraphs. Will it come to pass, that, after all, 
the vacuum tube electronics will not be converted to transistor elec- 
tronics, but rather, that it will just be forgotten? Perhaps transistors 
will next enjoy Shaw’s kind of childhood—one too wonderful to have 
been wasted on the young. 


An Experimental Switching System Using 
New Electronic Techniques 


By A. E. JOEL, JR. 
(Manuscript received May 27, 1958) 


This ws the first of a series of articles describing an experimental elec- 
tronic telephone switching system employing a number of new techniques. 
These include use of a stored program, a network employing gas tube cross- 
points, time-diviston common control and large-capacity barrier grid tube 
and photographic storage systems. 


I. INTRODUCTION 


Following recent activities in switching research! and the develop- 
ment of new solid state devices, engineering studies indicate that a 
telephone switching system using new electronic techniques is prac- 
ticable. An experimental electronic switching system designed and built 
for laboratory purposes is described in this paper. Other articles will 
present the various parts of the system in more detail (e.g., Refs. 3, 
4 and 5). 

Earlier papers have outlined many of the techniques which are 
available in electronic switching,®’ and the particular choices which 
were made for this experimental system have been publicized.® A brief 
review is given here. 

The experimental system may be said to have a space-division elec- 
tronic switching network for telephone connections, in which the con- 
nections themselves are made under the direction of time-division (one- 
at-a-time) common control. Large-capacity temporary and semiper- 
manent electronic storage units fulfill most of the memory requirements 
of the system. The time-division control uses a program stored in the 
semipermanent. memory. This program specifies the manner in which 
an office will function on various types of calls and provides various 
service features. Since a photographic memory medium is used in the 
semipermanent memory, the operating features of the office may be 
changed readily. 
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II, ORGANIZATION OF THE EXPERIMENTAL SYSTEM 


Fig. 1 is a block diagram of the major components of the system. The 
upper portion of the figure shows the section through which telephone 
connections are established. This is known as the switching network. 
It interconnects lines with other lines, lines with trunks, and lines or 
trunks with tone sources. 

The remainder of the system is its time-division control. The scanner 
is directed by the central control to examine the current flow condition 
of lines and trunks (current on or off), with the results of this examina- 
tion determining all actions in the information inputs to the system. 
The signal distributor seizes trunks and sends information over them to 
distant offices; it is directed to control the flow of current in the trunk 
circuit by the central control. The barrier grid store contains the tem- 
porary memory used to assemble the line and trunk call status informa- 
tion obtained from the scanner. The flying spot store holds in its per- 
manent memory information about the service characteristics of the 
lines and trunks and a program to direct all the control operations 
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Fig. 1 — Block diagram of experimental system. 
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which take place in the system. As its name implies, the central control 
is the focal point for directing each of the other components of the system. 

Obviously, the time-division control concept takes advantage of 
the speed of electronic devices. Its techniques will be described in more 
detail after the following discussion of the electronic space-division 
switching network, which illustrates the manner in which all major 
system components are controlled. 


III. SPACE-DIVISION SWITCHING NETWORK 


A space-division network is one in which physical devices are taken 
into use by a particular call for the entire duration of the call. A switch- 
able transmission circuit (in space) is established between the calling 
and called customers. All present-day electromechanical systems 
are of this type. Unlike previous space-division networks, however, 
this experimental system uses only electronic devices. 


3.1 Components 


The transmission path established through the experimental network 
has no metallic contacting elements like those in crossbar or step-by- 
step switches. Instead, each crosspoint is a two-element gas tube or 
gas diode (see Fig. 2) in which the gas breaks down when sufficient 
voltage is applied across the electrodes.?!° An electrical path is estab- 
lished through this gaseous discharge which transmits the speech cur- 
rent and controls the connection. 

As in a crossbar switching network, cascade stages with concentra- 
tion, distribution and expansion configurations are used. Each switch- 





Fig. 2 — Gas tube crosspoint. 
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ing network stage has its own control, which is called a marker and 
has subdivisions called a concentrator marker and a distribution marker. 

All network connections are made through several gas tubes in series 
(see Fig. 3). The number of tubes in series varies with the type of con- 
nection, eight being employed on an intra-office call and seven on calls 
between lines and trunks. Only one crosspoint tube is used in the con- 
centrator stage, but six are employed in the distribution switching 
network. 


3.2 Transmission 


All talking paths through gas tubes are single-wire with ground re- 
turn. Transformers are used to convert from line and trunk balanced 
pairs to the single-wire circuits in the sections of the switching network. 
Balanced pairs carrying only voice currents (dry circuits) also terminate 
in transformers between the concentrator and distribution switching 
sections of the network. In the present experimental system only in- 
office concentrators are used. However, this type of network and its 
controls can be readily adapted for use with remote concentrators. 

Electronic crosspoints restrict the power level of the signals which 
may be transmitted through the switching network. Therefore, a new 
telephone ringing arrangement has been developed for use with elec- 
tronic switching." The customer station set (lig. 4) is provided with a 
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Fig. 3. — Switching network plan. 
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Fig. 4 — Telephone set with tone ringing. 


transistorized tuned-circuit amplifier and a receiver element with an 
acoustic resonating chamber. 

Once transistorized amplification is placed in the telephone set, it 
is an obvious step to use it to improve speech side-tone transmission. 
In the experimental system the use of a lower line current (approximately 
10 milliamperes) permits a reduction in the size of the concentrator line 
transformers and the amplification in the telephone set helps overcome 
the insertion losses of the transformers. 


3.3 Ringing 


When the telephone receiver is on the switchhook the ringer is bridged 
across the line. A tone signal in the voice band that is sent through the 
switching network over the line to call a customer can be detected by the 
tuned circuit, amplified and radiated as sound energy. The tuned circuit 
responds to different frequencies for different parties, as in harmonic 
ringing. When the tone is transmitted the amplifier draws a small 
amount of line current, and this might look to the scanner like a receiver-_ 
off-hook or answer condition. For this reason, the scanner is directed to a 
line being rung only while its amplifier is drawing a minimum of current, 
during either the ringing cycle or the silent interval. 

The ringing tones are applied through a concentrator-like network 
called the signal switching network, which is controlled by the concen- 
trator marker. Two connections are set up through the signal switching 
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network whenever a line is being rung. One of these is for sending tone 
ringing to the called line, the other is for sending audible ringing tone to 
the calling line (see Fig. 17). Should difficulty be encountered in setting 
up the talking connection when the call is answered, an alternative con- 
nection will be established through the signal switching network, using 
paths previously engaged for the ringing functions. 


IV. FUNCTIONAL CONCENTRATION 


The control of the switching network serves to illustrate functional 
concentration, one of the principal features of the electronic switching 
system. To the rest of the system, the markers for the concentrator 
and signal and the distribution switching networks appear to be two 
black boxes. On command, they can set up or take down connections 
between trunks or between lines and trunks. 

The commands are electrical control signals received in parallel in 
two parts, one part known as the “address” or “location” at which 
something is to be done, the other as the “instruction” or “‘order’’. 
The addresses are specific line or trunk numbers in coded form, usually 
binary digits (bits). The orders are to set up or release a connection 
at the designated address. The way in which this control is effected 
is briefly described in what follows. 

In the marker, the address code is translated (from binary to one-out- 
of-n) and the electronic selector, in the form of a semiconductor diode 
matrix, applies a suitable voltage or “‘mark’”’ potential to address the line 
terminal on the grounded side of the transformer. Potentials elsewhere 
in the network are controlled so that the set up or release order may be 
executed to the marked point. As a result, a connection is established 
from one marked address point to another marked address point, or a 
connection to a marked address point is released. This is the so-called 
“end-marking”’ principle which has been previously employed in the 
electronic control of relay crosspoints.” In this application, however, 
electronic crosspoints are used as the transmission medium as well as 
for the memory and control functions. 

The switching network controls are designed so that, on release 
orders, the connection about to be released will be traced. At the end of 
a connection not being marked for release, the trunk will be identified; 
that is, its address in binary form will appear in the marker as the con- 
nection is released. This trace or identification operation occurs as part 
of each release order; it is used to process disconnect information for the 
trunk. Fig. 5 shows the switching network of the experimental system 
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Fig. 5 — Experimental switching network. 


setup, which uses 3 X 3 switches in the distribution switching network 
and 2 X 2 switches in the concentrator and signal switching networks. 
The marker circuits are located in the rear. 

Most system components have a limited amount of output information. 
In the case of the switching network the output is a signal that a con- 
nection was either ‘‘set up” or “ not set up” (due to blocking or trouble). 
As will be shown later, other major components of the system employ 
this same functional concentration method of control with address and 
order inputs and simple outputs. 

Table I lists the ‘‘address’’, ‘‘instructions” and “outputs” of each of 
the major blocks of the system. With the functional concentration con- 
cept, each major unit may be viewed from a system standpoint as a 
black box to which may be assigned a simple but complete statement of 
what it can do. Here there is considerable contrast between electronic 
and modern electromechanical common control systems. In the latter 
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TABLE I — COMMANDS 









































Block of System Address Instructions Outputs 
Concentrator Line Connect Side A Successful 
Connect Side B Blocked 
Trace Busy 
Trunk Release 
Distribution Network | Trunk, Side A Connect Successful 
Trunk, Side B Release Blocked 
Busy 
Scanner Line Interrogate i 
1 
Signal Distributor Trunk (or Line) | Set —— 
Reset 
Barrier Grid Store Spot Coordinate | Regenerate (Read) 
(x and y) Reverse (Read) 0 
Write 1 1 
Write 0 
Flying Spot Store Spot Coordinate | Advance Command 
(x and y) Transfer 
Expose 
Off Plate 


case, it is sometimes difficult to assign a broad system function to each 
of the inter-unit control paths. 


V. TIME-DIVISION CONTROL 


5.1 Speed Advantage 


A switching network employing gas tubes and controlled in the 
above manner is more than 10 times faster than conventional networks 
employing electromechanical devices. This speed advantage is utilized 
in several ways. First, “one-at-a-time’”’ operation is made possible; 
that is, sufficient capacity is available so that, even for large offices, 
only one marker is required to handle all. the traffic. Second, system 
functions which usually are performed in trunk and register circuits 
may be performed by temporarily establishing certain network connec- 
tions. For example, incoming trunk circuits in many electromechanical 
systems ring the called party and return audible tone to the calling 
party [see Fig. 6(a)]. In this electronic system, each of these functions 
is accomplished by setting up separate network connections from the 
appropriate line to a signal source [see Fig. 6(b)]. 
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But electronic crosspoints are slow compared with speeds which may 
be obtained with the other electronic elements in the experimental 
system, such as transistors and semiconductor diodes. The use of de- 
vices of this type enables the control portions of the system to process 
all the information concerning each call on a ‘‘one-at-a-time”’ or time- 
division basis. This is possible because these devices are from 1,000 to 
10,000 times faster than electromechanical elements. 

The experimental electronic system is of the common control type, 
with the control serving all calls during their establishment and re- 
lease but not during conversation. Tinie-division common control 
means that the control as a whole is acting on only part of one call at any 
particular instant of time. Transistor and diode logic circuits, known 
collectively as the central control, process call information among the 
various functionally concentrated system components on a one-at-a-time 
basis. 

For purposes of control, each second of time is subdivided into hun- 
dreds of thousands of information-processing cycles. During each of 
these cycles, one or more system components may be commanded to 
perform one of its functions for a single call. The information processed 
by the central control comes from the system inputs, the lines and 
trunks. To gather this information, another functionally concentrated 
system element, the scanner, is employed to convert information oc- 
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Fig. 6 — (a) Example of trunk circuit functions in electromechanical system; 
(b) example of use of switching network for signaling and supervisory functions. 
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TaBLeE II — LINE ConpliITIONS 


Scanner Output Line Condition 


0 1 





sas Request 
0 Idle or Dialing F An 
Barrier grid store output Service or Dialing 


(line spot L1) 





1 Disconnect Talking 








curring simultaneously on all lines and trunks into a series of time-re- 
lated events. 

Two major system components, the scanner and signal distributor, 
play a most important role in the time-division control, since they permit 
the interchange of information signals to and from space-separated 
inputs and outputs (lines and trunks). The experimental system is fur- 
ther limited to one-at-a-time operation because the barrier grid store can 
only read, write or regenerate one memory bit at a time and the flying 
spot store can only read out one word at a time. The basic rate for all 
of these one-at-a-time information processing operations is in the range 
of 100 kilocycles per second. 


5.2 Scanner 


The scanner is a collection of transistor and diode logic circuits ar- 
ranged to examine an addressed line or trunk and determine whether 
current is flowing in it. A telephone line normally has no current flowing, 
but, when the receiver is raised from the switchhook, current flows. 
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Fig. 7 — Line circuit. 
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Fig. 8 — Experimental central control (including scanner and signal distributor). 


This flow is interrupted during each dial pulse. If the scanner is ad- 
dressed (directed) to the line during a receiver-on-hook condition or in 
the middle of a dial pulse, no scanner output results, but if it is addressed 
to the line when the receiver is off-hook and not in the middle of a dial 
pulse, an output signal is given by the scanner (see Table IJ). There are 
a few simple passive elements per line or trunk in the scanner. These, 
together with concentrator switching network line crosspoints and 
selector, are the only per-line units in the system (see Fig. 7). The 
experimental system includes a skeletonized version of the scanner since 
only a few lines and trunks are served. It is shown as part of the central 
control equipment in Fig. 8. 

The scanner serves several different purposes. First, it is directed to 
each line every 0.1 second to determine if the line is requesting service 
to start a new call, if the line is in use or if the customer has hung up. 
Once a request for service is detected, the scanner is directed to the 
line every 0.01 second so as to be sure to recognize the shortest detect- 
able open period that may occur on a line with a 20-pulse-per-second 
dial. Fig. 9 illustrates the two scanning rates as they occur on a calling 
line. The scanner is also directed to called lines approximately every 0.1 
second during ringing to detect whether the call has been answered. If 
it has, the ringing of the called line is stopped by release of the connec- 
tion from the ringing trunk. 
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5.3 Signal Distributor 


The scanner gathers information when directed; the signal distributor 
is the component which performs the inverse function: “effecting.” For 
the experimental system it is skeletonized as shown in Fig. 8. The signal 
distributor consists of a large number of output flip-flops (two-state elec- 
tronic circuits) which are either set (operate) or reset (release) as de- 
termined by addresses and commands sent to it from the central control. 
The flip-flops respond rapidly, so that these commands may be given to 
the signal distributor at speeds in keeping with the logic of the central 
control. The flip-flops can then operate relays or other devices which 
must be used on individual lines or trunks for signal-control purposes. 

An example of this is the sending of supervisory and dial pulse signals 
over trunks. The signal distributor is addressed to a device in the trunk 
circuit which will close the loop. Sufficient time must then elapse before 
the first dial pulse may be sent to allow relays at the distant end of the 
trunk to respond. During this time (hundreds of milliseconds), the high- 
speed electronic system controls are busy performing other functions, 
and the signal distributor may be ordered to set or reset other flip-flops 
for other slower-speed control needs, such as originating calls on other 
trunks. Dial pulses are sent (see Fig. 10) by repeatedly addressing set and 
reset orders at the required rate (10 or 20 pps) to the flip-flop associated 
with the trunk. During each of these periods the signal distributor may 
be sending pulses, as directed, over several trunks. 

The signal distributor is also used for effecting other slow-speed out- 
put functions, such as returning called party supervision to originating 
offices over incoming trunks. The only slower-speed system functions 
not performed by the signal distributor are those which take place in 
the network markers. 
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Fig. 9 — Two-rate scanning of calling lines. 
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VI. LARGE-CAPACITY MEMORIES AND THEIR USE 


6.1 Barrier Grid Store 


There are two types of memory used at present in electromechanical 
systems: changeable memories, which store call status information such 
as called numbers as they are dialed, and translation memories, which 
store information that is needed for determining the routing of a call. 
Changeable memories usually are locking relays or selector switches with 
a number of positions (multistate locking relays); translation memories 
usually are nothing more than cross connections or relay contacts wired 
so that operating combinations will produce a desired action. 

The memory functions of the experimental electronic office are func- 
tionally concentrated in new high-speed electronic memory media. The 
“call status” or “temporary”? memory is in the form of a barrier grid or 
electrostatic storage tube.“ Each tube is integrated into a complete set 
of electronic circuits to control the selective addressing, reading and 
order-writing of any one of the thousands of spots in a few microseconds. 
The complete assemblage is known as a barrier grid store. The store used 
in the experimental system is shown in Fig. 11 and described in detail 
elsewhere in this issue.* The barrier grid store is used to record all of the 
call status information for each line, trunk, register or sender, as relays 
do in electomechanical systems. The memory spot array of this tem- 
porary memory medium is subdivided for these functions. 

Each line and trunk has two spots associated with it. The state (0 or 
1) of one of these spots (L1) is related to the condition of the line the 
last time it was scanned. The other spot (L2) indicates whether the line 
or trunk is being served by the control portion of the system; usually, 
this means that a coded representation of the line number is stored in 
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Fig. 10 — Outpulsing by signal distributor. 
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Fig. 11 — Experimental barrier grid store. 
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some group of spots in the barrier grid store. In addition, there is a spot 
(T8) assigned for each trunk of a group to aid in the hunt foran idle trunk. 
These spots are grouped so that the T3 spots of all trunks in the same 
group are adjacent. 

Generally, all spots other than line or trunk spots are grouped by func- 
tion and called “registers.” Registers are assigned so that they comprise 
columns of spots; that is, the spots for any one register have the same 
x address coordinate. In the experimental system there are six types of 
registers: 

1. Originating registers — to record dial-pulsed calls and control the 
completion of intra-office calls. 

2. Outpulsing registers — to store information that controls the send- 
ing of called numbers over a trunk to a distant office on a dial-pulse 
basis. 

3. Ringing registers — to store information that controls the ringing 
of the called line and the sending of audible ringing to the calling line. 

4, Disconnect registers — to store information that controls the re- 
lease of established connections. 

5. Main program register to store information relative to the 
identity of any particular 0.005-second division of time (the basic time 
subdivision of the system). 

6. Network register — to store information concerning the type of 
call being handled by the network so that the appropriate program se- 
quence can be referred to at the conclusion of a network action. 

To enable adequate control by the central control and stored program, 
the amount and type of information stored in their spots varies among 
the register types. Table III lists this information for each of the register 
types. Note that spots are used much like relays in electromechanical 
switching systems to store coded line or trunk equipment numbers, 
dialed digits, number of digits dialed (digit location counter) and other 
numerical items. Other spots are used for call status indications such as 
“dialing completed” or ‘‘network requested”. Fig. 12 shows a typical 
assignment of line, trunk and register spots in the square memory array 
of the barrier grid tube. 

Registers of categories 1 through 4 above are considered as call-carry- 
ing registers. The number of each of these types provided is dependent 
upon the amount of traffic to be handled by the system. All registers of 
a given type are usually set up so that their corresponding spots have the 
same Y address. In this way, the barrier grid store is used so that the x 
address indicates the type of register and the y address the particular 
spot in the register. 
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Each of the call-carrying registers has at least one spot which is used 
to indicate its busy or idle condition. This spot is known as the “ac- 
tivity” spot and is used when a search is made for an idle register. This 
concept for register-busy tests is similar to that used for physical trunk 
(or line) facilities (T3 spots), but it applies only to an entire group of 
spots in a column. 


AN EXPERIMENTAL SWITCHING SYSTEM 1107 


Spots in the registers may be reused for different call functions at 
different periods during the progress of a call, thus reducing total memory 
requirements. or example, groups of four spots are used to record the 
numerals of the called directory number as dialed. When dialing is 
completed and it has been determined that the call is intraoffice, the 
equipment number of the called line, translated from the directory num- 
ber in the flying spot store, is stored by the spots which formerly held 
the called directory number. 

Some functions in electromechanical systems depend upon the dif- 
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Fig. 12 — Barrier grid store spot layout. 
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Fig. 13 — Experimental flying spot store. 
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ference in operate or release time of two or more relays. Such arrange- 
ments are used to distinguish a dial-pulse line opening from a call aban- 
donment or a line closure between dial pulses from an interdigital 
interval. Slow operate or release relays are also used to determine time 
intervals such as those needed to distinguish a short accidental operation 
of the switchhook or a hit on the line from a disconnect. In the experi- 
mental electronic system, a time-counting technique employs barrier 
grid store spots which are part of the various registers. A counter con- 
sists of a group of spots. If a count is to be scored, the binary record in 
the spot group is changed by recording the next higher binary number. 
Scoring is under the control of the main program and may occur each 
0.005 second or a multiple thereof. 


6.2 Flying Spot Store 


The second new type of memory provides the ‘‘semipermanent”’, 
‘“‘translation” or “‘wired-in” functions, using photographic plates as the 
memory medium, with digital information being recorded as transparent 
or opaque spots. These plates, together with an optical system, a cathode 
ray tube with digital-servo deflection control and photocells, are com- 
bined with electronic addressing and amplifier circuits in what is known 
as a “flying spot store’. As described elsewhere in this issue,‘ stores of 
this type are capable of recording on photographic plates, selectively 
addressing and reading any word group of bits of stored information in a 
few microseconds. Fig. 13 shows the flying spot store used in the experi- 
mental system. 


6.3 Plate Exposure Process 


The information to be placed on the photographic plates is first key- 
punched into business machine cards, each card containing an address 
and the order to be stored at that address. These cards are then processed 
by punched card business machines which produce a magnetic tape with 
information arranged by successive flying spot store addresses, a channel 
at a time. This tape is then read by a portable exposure control unit, 
Fig. 14, which is temporarily connected to the flying spot store. Unex- 
posed photographic plates are inserted into their channels one at a time 
while the exposure unit reads the tape, addresses the store and turns 
the cathode ray beam on or off as determined by the information read 
simultaneously from the tape. Each plate is exposed in a few seconds 
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Fig. 14 — Experimental exposure unit. 


and then removed to be developed. After being exposed and developed, 
all plates are inserted back into the proper channels. The magnetic tape 
may be rerun with the exposure unit in a “ verifying’ mode of operation, 
in which the channel outputs are compared, one at a time, with the mag- 
netic tape which was used to control exposure. In this way, any exposure 
or developing errors may be detected before the plates are used in the 
system. Once verified, the store may be disconnected from the exposure 
unit and connected to the system central control. 
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VII. SYSTEM TECHNIQUES 


7.1 Stored Program Technique 


One of the techniques which is basic to the design of flexible and 
general-purpose digital computers is also of great value to the present 
experimental electronic switching system. This is known as ‘“‘the stored 
program,” in which binary-coded information is stored and read out of 
the flying spot store as needed to control most of the system’s actions. 

In a sense, the stored program is a further effort to concentrate func- 
tionally. In electromechanical systems the determinations of sequences 
and consequences of decisions are based on the predetermined circuit 
wiring in many circuits, markers, registers, senders, trunks, lines, ete. In 
the electronic system the flying spot store contains sequences of coded 
commands for the various parts of the system. This memory is 
ideal for this function since it is permanent and can be changed only 
by changing photographic plates. Changes in the program are engen- 
dered only when a change in service or administration is necessary. 

Each order readout of the flying spot store is first interpreted by the logic 
circuits of the central control in one cycle. Thus, the proper gating and 
forming of the command to another system component may be executed 
when the next order is read into the central control from the flying spot 
store. Sometimes the commands are combination orders for two system 
components, as discussed above for the supervisory line scan. Other 
commands for a system component may require more information than 
can be contained in a single output word from the flying spot store. An 
example is a command to a marker, in which the parts of the network 
command are assembled in transistor flip-flops in the central control 
during several word readouts from the flying spot store until the com- 
plete command is ready. 

The stored program is designed to be self-perpetuating, so that the 
system will not stop for lack of knowing what to do. To achieve this, 
the addressing of the flying spot store is advanced automatically one 
step at a time in the x coordinate on each readout cycle. This automatic 
advance is internal to the store, but a duplicate record of the 
address at which the flying spot store is directed is maintained in the 
central control. 

There are two ways of changing the y (or x) coordinate of the address 
to jump the reading to a different portion of the photographic plate. 
The most important of these is the “decision” transfer, in which the flying 
spot store address is changed according to the interpretation of the out- 
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puts from one or more system components. The other type of trans- 
fer is of the ‘nondecision” type, which is used when jumping to ad- 
dresses where translations appear, rather than the program. This type 
of order is also used when the end of one program section is reached, to 
permit advance to the next section which may be at a completely differ- 
ent address. 

Use of the stored program technique permits the command sequences 
to be tested independently of the switching system. Simulation of the sys- 
tem is accomplished with modern high-speed electronic digital computers. 
Some 19 kinds of calls were successfully simulated using the stored pro- 
gram on a computer before the experimental system itself became oper- 
ative. 


7.2 Main Program 


As implied above, the program is made up of many sections. Hach 
section contains orders or instructions for handling a particular system 
routine or type of call. Flow or sequence charts are used extensively to 
make possible precise specification of required system actions. As may 
be observed from Tig. 15, which is a layout of the words stored in the 
flying spot store for the experimental system, some sections are related 
directly to the types of subdivisions of the barrier grid storage medium. 
Other sections are related to the frequency with which actions are 
performed in the system, such as the 100-millisecond line scan or the 
10-millisecond dial pulse scan, and to the instructions for dealing with 
network actions and making translations from directory to equipment 
number. Overseeing all these routines is a main program which determines 
the sequence and time limitations, if any, for the individual routines and 
instructions. The end of each routine or sequence causes a transfer to 
the next point of the main program. To start the system into operation, 
the flying spot store is addressed to the beginning of the main program 
and thereafter the action should be self-perpetuating if the program is 
logically correct. 

The main program is a timetable and priority list of the major func- 
tions which the system must perform. Successive cycles of the main pro- 
gram are usually not the same. In the experimental system the main 
program cycles are normally 5 milliseconds in length. Barrier grid store 
spots are assigned (see Fig. 12) and used to keep track of the cycle num- 
ber so that the predetermined main program for that cycle may be 
carried out. Odd-numbered 5-millisecond cycles may scan lines for odd- 
numbered originating call registers and even-numbered cycles scan lines 
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Fig. 15 — Flying spot store spot layout, with typical random access program 
sequence. 


for even-numbered registers. Once during 20 cycles the main program 
shifts to various functions that must be performed each 0.1 second. 
Most cycles provide intervals for commanding or acknowledging com- 
pletion of network actions. A conventional busy test of the network is 
made during one central control cycle, as part of a main program se- 
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quence to determine whether the network may be addressed during this 
cycle of the main program. This characteristic is known as “network 
break-in”. Similar break-ins alter the main program for synchronizing 
the scanning of lines for answer during modulation cycles of the ringing 
tone. Tig. 16 shows a typical main program cycle. It should be noted 
that the main program is another manifestation of the time-division 
form of system control. 

~ Since each main program cycle may take a different length of time to 
carry out its intended functions, depending upon the amount of traffic 
and break-ins, there is an independent 5-millisecond timing circuit in 
the central control which the main program refers to after each routine 
or functional sequence has been completed. In this way, a cycle longer 
than 5 milliseconds is ended as soon as possible. 
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Fig. 16 — Main program. 
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7.3 Central Control 


Fig. 1 shows the interrelation of the major components of the system 
described in the previous sections. Note that the commands for all the 
system components pass through central control. The central control, 
shown in Fig. 8, contains circuits which use 1500 germanium alloy junc- 
tion transistors and 15,000 germanium point contact diodes. These cir- 
cuits, which are combined to perform the required logic functions, are 
described in detail elsewhere in this issue.5 | 

The central control makes all decisions which control the flow of com- 
mands to the various parts of the system. 

None of the system’s components can work alone or make decisions 
which will change the routing of a call or other system action. In many 
cases, the central control must command and receive output information 
from more than one component before a decision is made. For example, 
reading the scanner output alone is not enough to make a decision that 
a new request for service or a disconnect has originated. To do this, the 
call status store (the barrier grid store) must be consulted. In the store 
there is a memory spot associated with each line, which is examined at 
the same time the scanner is directed to the line circuit. This spot is 
kept up to date by commands from the central control indicating what 
the scanner saw the last time it was directed there. By comparing, in 
the central control, the output of the scanner and the barrier grid store 
at the address corresponding to each line, it is then possible to decide 
whether there is a request for service or disconnect. (See Table II). 

Another example of this cooperation is in setting up a network con- 
nection to an idle trunk. The network addresses for the trunks to a 
particular destination are reached by addressing the flying spot store on 
the basis of the office or service code dialed. The word read out of the 
flying spot store gives translation information such as the class of the 
trunk, as well as the network address. Before the address is passed to 
the network marker with a command to set up the connection, a spot in 
the barrier grid store associated with the trunk is addressed to determine 
whether the trunk is idle. 

In the first of these two examples of cooperation, the actions in the 
various system components occurred simultaneously. In the second, the 
cooperation occurred as a sequence of actions based on information re- 
ceived from one component and passed via the central control to another. 
This means that a certain amount of short-term memory, using transistor 
flip-flops, is needed in the central control. The information is stored 
temporarily for one or more cycles until this small step in the call has 
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been completed or while it is being worked on by a slower part of the 
system, such as a network or trunk. 


VIII. CALL DESCRIPTION 


Having described the various parts of the experimental electronic 
system and the new techniques employed, we may now trace the progress 
of a call through the system. The high-speed time-division type of con- 
trol makes it necessary to describe more steps for a complete call than 
are necessary in an electromechanical system. It has been estimated 
that, at the level of detail with which a call will be described in this sec- 
tion, three times as many steps are required than for a comparable 
description of a call progressing through the most modern electrome- 
chanical system. 

The description will assume an intra-office call to an idle line. No 
special situations such as call abandonments, all registers or trunks busy, 
permanent signal or partial dial, network blockage or busy, translation 
changes, reverting calls or overloads on the control will be covered. How- 
ever, the experimental system is designed to care for all of these situations. 

1. Detect Call Origination — With the system components function- 
ing, the main program causes each line to be scanned every 0.1 second. 
Approximately one-twentieth of the lines are scanned on each 0.005- 
second main program cycle. Simultaneously, one of the line memory 
spots (L1) corresponding to each line being scanned is examined for a 
change in line state. When the calling party lifts the receiver from the 
hook, the change is detected on the next 0.1-second scan or, on the 
average, within 0.05 second. 

2. Hunt For and Seize Idle Originating Register — After the call 
origination has been detected, the availability spots of originating regis- 
ters are examined until an idle register is found. It is then made busy, 
and all information previously recorded, which might confuse this call, 
is erased. The calling line equipment number is written in the appropriate 
spots of the originating register. A register spot is marked to indicate that 
it desires to use the network to set up a connection to a dial tone trunk. 
The L2 spot of the line is marked to indicate a call is now being served 
by a register. 

3. Dial Tone Connection— Assuming the concentrator marker 
is available, it is addressed with the originating line equipment num- 
ber. The program order address, which will be required later for the 
next network action, is placed in the network register. The concentrator 
marker sets up a connection from the calling line through the concen- 
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trator to a trunk to the distribution switching network, preferably the 
A or left side. In this process the identity (address) of the trunk is re- 
corded in the marker. The main program, in the meantime, continues 
to complete the 0.1-second scan of lines and other functions. Once in 
each 0.005-second main program cycle the network markers are exam- 
ined to see if the network is ready for new action (network break-in). 

To continue the network actions, the next flying spot store address is 
read from the network register in the barrier grid store. This program 
includes routines for the flying spot store to obtain dial trunk spot ad- 
dresses in the barrier grid store. These spots are examined until an idle 
trunk is found and marked busy. Its address is then used in the flying 
spot store to find the address of this trunk on the distribution switching 
network. Together with the trunk number from the concentrator marker, 
the address is then placed in the distribution marker with an order to 
establish the dial tone trunk switching network connection. Once the 
connection has been successfully established, the calling line receives 
dial tone and the distribution marker awaits a main program break-in. 

. When this occurs, the network register is made idle and the originating 
register is marked to indicate that the dial tone connection to the cus- 
tomer is complete and dialing may now start. 

4, 10-Millisecond Dial Pulse Sean — At the beginning of each 0.005- 
second main program cycle, half of the originating registers are examined. 
If any are busy with a call in the dialing state, the originating line 
equipment number is read out into the central control, which then di- 
rects the scanner to the line to determine if there has been a change from 
the last time (0.010 second ago) the line was examined. This process 
continues every 0.010 second as long as dialing is expected. 

6. Detect First Dial Pulse — To avoid changing the L1 line spot with 
each dial pulse, a “last look” LL spot is provided in the originating reg- 
ister, and this is read out along with the line number when the scanner 
is directed. This spot is compared with the scanner output and, if a 
change from closed to open is noticed, the beginning (open) of the first 
dial pulse is detected. As a result, the dial-pulse counter spots are changed 
to read binary 1 and the abandoned call-timer spot is erased to start a 
time-count cycle if this line open is longer than a dial pulse. Each suc- 
ceeding change from closed to open of 0.010-second scans increases by 
one the binary number in the pulse counter spot. 

6. Release Dial Tone Connection — The originating register spot 
indicating there is a dial tone connection is examined after the first pulse 
is detected. A test is then made to determine if the network is available. 
Assuming the distribution network marker is idle, the calling line equip- 
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ment number is read out of the originating register and transferred to 
the marker with an order to release the dial tone connection. The line 
number is coded so that it includes the number of the concentrator 
switch and the trunk. Only this part of the line number is read out to 
mark the end of the trunk in the distribution switching network which is 
to be released. When the connection is released, the identity of the dial 
tone trunk appears in the distribution marker and is passed to the 
central control on the next network break-in of the main program. With 
the dial tone trunk number known, the trunk busy spot T3 is changed 
to show that the trunk is now idle. It should be noted that the concen- 
trator connection is maintained, so that later connections to the calling 
line will not block in the concentrator. 

7. 100-Millisecond Examination of Originating Registers — Each 0.1 
second the main program causes the abandoned call or interdigital time- 
count spots of the busy originating register to be changed. On each line 
change detected on the 0.010-second dial-pulse scans, these time counter 
spots are restored to zero. If a count of two is reached with the last look 
spot showing a line-open condition, an abandoned call is detected and 
the network is requested to release the concentrator connection. A count 
of two with the line showing a closed condition indicates the end of a 
digit. The binary count in pulse counter spots is read and stored in the 
central control and the counter cleared in anticipation of the next digit. 

8. Move Dialed Digit to Digit Register Spots — A group of spots 
known as the “digit location counter” spots is read to indicate to the 
central control the y address at which the dial-pulse count is to be stored. 
The binary number in the digit location counter is increased by one. The 
dialed digit is then written into the appropriate digit spots of the orig- 
inating register. The main program then continues to make the 0.1 sec- 
ond examination of the time counter of next originating register. 

9. Recognizing Local Central Office Code — When the digit location 
counter reads 3 and the third digit is transferred to the appropriate set 
of digit spots, the first three dialed digits are read out and referred as an 
address to a translation area of the flying spot store. The resulting out- 
put will indicate, among other things, that the call is intra-office, so an 
indication is made in the originating register that the call is not an out- 
going or service code call. 

10. After Registering Seven Digits — When the seventh digit has 
been counted and registered during a 0.1-second examination, the spots 
which indicate the state of the register are marked to show that dialing 
is completed. Thereafter the 0.010-second dial pulse scan is not made for 
this register. 
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11. Translation of Called Number — Since this is an intra-office call 
the four called numerical digits (16 bits) are read out into the central 
control. Some of these digits are referred to a special translation area of 
the flying spot store to compress the coding so that the line translation 
address will fit the address limitations of the store. The called line trans- 
lation is then made from the compressed directory number to an equip- 
ment number and class of service of the called line, including ringing in- 
formation. 

12. Party Lines — Reverting Calls — If the ringing information in- 
dicates a party line has been called, the calling line equipment number 
is read out of the originating register and matched in the central control 
against the called line equipment number to determine if the call is for 
another party on the same line. 

13. Place Called Equipment Number in Originating Register — The 
called equipment number in coded form is written in the same spots 
where the called directory number was accumulated. The interpretation 
to be placed on this information in the future is determined by the code 
recorded in the call status spots of the register. 

14. Line Busy Test — The called line number is used by the central 
control to examine the line spots to determine whether or not it is idle. 
If it is idle, the L2 line spot is changed to indicate that the line is being 
served by the control portion of the system. 

15. Establish Ringing Connection (Fig. 17 should aid in understanding 
these connections; refer to the circled numbers) — With called line and 
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Fig. 17 — Ringing connections. 
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the network markers idle, the ringing function is started. @ The called 
equipment number is placed in the concentrator marker with a command 
to set up a connection between the called line and an idle trunk to the 
right or B side of the distribution switching network. This completes the 
actions taken during this 0.1-second register examination by the main 
program for this call. The number of the trunk to which a connection is 
established from the called line is read out of the concentrator marker and 
placed in the central control on the next network break-in operation. An 
idle ringing trunk is then hunted by examination of spots in the barrier 
grid store, and an address is obtained from the flying spot store in the 
same manner as for the dial tone trunk (item 3). The ringing trunk num- 
ber and the address of the trunk from the concentrator connected to the 
called line are held in the central control. The former is used as an address 
for the next operation of the concentrator marker @), when the audible 
ringing tone is applied to one of the tone switch output trunks to the 
right or B side of the distribution switching network. In the process, the 
particular trunk which is used from the tone switch is identified. 

On the next network break-in, the distribution marker is given the 
address of the output trunk of the ringing switch through which the 
audible ringing tone is connected. The address of the trunk connected 
to the calling line, as interpreted by the central control on reading out 
the calling line equipment number from the originating register, is also 
read into the distribution marker, and the required distribution network 
connection (3) is set up. The calling party now hears ringing tone. The 
originating register number is held in the network register so that it 
knows what call it is handling. 

The next network break-in is used to establish the ringing tone path 
to the distribution switching network through the signal network @,. The 
identity of the trunk from the ringing tone to the distribution switching 
network is passed to the central control on the next break-in. At this 
time the final link G) for the ringing connection is established. Tone 
ringing current of the correct frequency now rings the called telephone. 

16. Hunt For and Seize Idle Ringing Register — On the next network 
break-in of the main program the distribution marker reports the com- 
pletion of the last link of the ringing connection. The barrier grid store 
is addressed, by the stored program referred to by the network register, 
to search for an idle ringing register. The selected register is then made 
busy. The called line equipment number and the address of the trunk 
connected to the ringing tone on the trunk switching network are written 
in the register. 

17. Release of Originating Register — The calling line spots are now 
changed from the control condition and set to indicate talking. The orig- 
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inating register availability spots are changed to indicate that the register 
is now idle and available for use on a new call. 

18. Scanning Called Line for Answer — Each 0.005 second during the 
silent period of the ringing cycle, or when the ringing modulation goes 
through zero, the called line number is read out of the ringing registers. 
The line number is used to address the scanner to detect the call answer. 
The register also has spots which time the ringing period so that a limit 
may be placed on unanswered time. 

The answer is detected as a change from line open to closed during the 
appropriate 0.005-second main program cycle. At this time, the line 
spots of the called line are taken out of the control condition and put into 
the talking condition. 

19. Release of Ringing Connections — Commands are issued simul- 
taneously to the concentrator and distribution markers with information 
read from the ringing register to release the ringing switch and trunk 
switching connection to the called line. 

On the next network break-in after these release functions have been 
successful, the trunk addresses identified in this process are held in the 
central control for use in establishing the talking connection. Release 
commands are now sent again to the network markers to take down the 
audible ringing connection to the calling party. This is also based on the 
knowledge of the ringing switch trunk address now stored in the ringing 
register. 

20. Establish Talking Connection — On the next network break-in 
upon the successful release of the second half of the ringing connection, 
a command is given to the distribution marker to establish a talking 
connection. 

On the next network break-in, when the successful establishment of 
the talking connection is reported, the availability spot of the ringing 
register is changed to make it available for another call. 


The conversation between the two parties now takes place. 


21. Detect Disconnect — The main program continues to cause each 
line to be scanned every 0.1 second. When, referring to the line spots, a 
change from line closed to line open is detected on either the calling or 
called line, a disconnect program is started. 

22. Hunt For and Seize Idle Disconnect Register — A search is made 
immediately for an available disconnect register. The line number is re- 
corded in the appropriate spots and the time-counting spots are set to 
zero. . 

23. Disconnect Timing — Each 0.1 second the main program incre- 
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ments the timer until at least 0.3 second has elapsed. At this time, a spot 
in the register is marked to indicate a request for the network when 
next it is idle on a break-in portion of the main program cycle. On each 
count scoring the timer, the line number is read out of the barrier grid 
store to address the scanner. This insures that the disconnect is bona fide, 
since a line hit might also have caused the line to appear open momen- 
tarily when the line open was originally detected. During this timing 
interval the other party’s disconnect may also be detected. A different 
idle register is seized and timing started. 

24. Release Talking Connection —If the network is idle, the line 
equipment number is read from the disconnect register and placed in 
the concentrator marker as the address part of a trace command. As on 
all network operations, the number of the disconnect register is written 
in the network register, together with the type of network action taking 
place. 

On the next network break-in of the main program, the concentrator 
marker reports back to the central control with the number of the trunk 
being used by this line in the trunk switching network. The network 
markers may now proceed to accept release commands based on this 
trunk number. 

The distribution marker identifies the address of the trunk connected 
to the other party’s concentrator. On the next network break-in after 
successful execution of the previous commands, this address is given to 
the concentrator marker with a command to release the last link of the 
intra-office connection. 

On the next network break-in, when the successful execution of this 
last command is reported, the disconnect register 1s again made available 
and the line spots of the line whose number is read out of the disconnect 
register are changed from the control to normal supervisory state. 

Later, when the other party’s disconnect is detected and timed, the 
concentrator marker, in response to the trace command, finds the con- 
centrator connection already released and so reports this condition on 
the next network break-in. At that time, the disconnect register and line 
spots are‘restored to their normal states. ; 


Ix. CONCLUSION 


A number of new electronic switching techniques have been described 
and their applications in the first experimental laboratory system illus- 
trated. This system is shown in Fig. 18 as it was assembled for proving 
the feasibility of these new approaches. In addition to the features de- 
scribed, the left bay of the central control (Fig. 8) contains key and 
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Fig. 18 — General view of experimental system. 


indicating equipment to aid in the testing of the system. This includes 
means for regenerating the barrier grid store when the system program 
is not functioning during the location of trouble and means for inserting 
orders into the central control manually. 

Descriptions of the circuit, apparatus, equipment and program de- 
tails appear elsewhere in this issue and will be published in future issues 
of this publication. 

Much has been done to develop the techniques of this experimental 
system to the point where they should be satisfactory for use with traffic 
from telephone customers. Other system considerations are being de- 
veloped before the commercial and trial applications of these techniques 
take place. Maintenance facilities; system expansion beyond the mem- 
ory capacities of the present stores; administrative procedures, including 
traffic recording, remote concentrators, power facilities and other serv- 
ices such as operator class calls are among the new system items which 
are being developed. At the same time, intensive study of component 
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and system reliability is proceeding to insure the successful operation of 
this system. 
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Semiconductor Circuit Design Philosophy 
for the Central Control of an 
Electronic Switching System 


By B. J. YOKELSON, W. B. CAGLE and M. D. UNDERWOOD. 


(Manuscript received November 12, 1957) 


The advent of electronic switching has necessitated a considerable number 
of changesin the circuit design philosophy employed in the electromechant- 
cal switching art. The invention of the transistor and the refinement of other 
semiconductor devices have made possible new techniques. This paper dis- 
cusses the philosophy of circuit design for the central control of an electronic 
switching system. Primary emphasis in the designs has been low cost con- 
sistent with good margins, reliability and the meeting of systems require- 
ments. 


I. INTRODUCTION 


The proper selection of semiconductor switching circuits to be em- 
ployed in electronic switching systems is influenced by a large number 
of different factors. Some of these are the result of systems philosophy,}! 
while others are concerned with device availability, required reliability, 
economy and ease of design, manufacture and maintenance, etc. We do 
not propose to go through an exhaustive design analysis of the circuits 
described herein, but we shall present the techniques which were de- 
veloped. 

The particular experimental electronic switching system of interest 
here operates with a stored program in real time and in a generally 
synchronous serial mode, utilizing direct-coupled (dc) logic. The largest 
concentration of semiconductor circuitry is in the central control of the 
system, which is the data and information processing center of the tele- 
phone central office. It is with the circuits in the central control that this 
paper is mainly concerned. 

In most present-day electromechanical switching systems many op- 
erations take place in parallel, due to the speed limitations of relay cir- 
cuits. Electronic switching systems also can be built using the parallel 
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building block approach, but significant savings in quantities of appara- 
tus are possible if serial operation is employed. The serial mode, how- 
ever, makes it necessary for the processing equipment to operate at 
much higher speeds. In fact, for the particular electronic system under 
consideration, it is necessary for a program order to be executed in a few 
microseconds if the office is to handle the telephone traffic properly. 

Although most parts of the electronic switching system operate in a 
serial mode, the central control itself operates in a parallel mode. The 
speed limitations of available semiconductor devices and circuits are a 
contributing factor to this choice. However, the program order structure, 
the manner in which information is stored in the system and the way in 
which the central control affects the operation of the other major system 
blocks in the office are of even greater importance in the selection of the 
parallel mode. It should be noted, however, that in receiving address 
words from the barrier grid store some serial-to-parallel conversion 
equipment is required, since this memory furnishes information only one 
bit at a time. 

The central control operates in a generally synchronous manner, using 
a single-phase clock having a frequency of several hundred kilocycles. 
However, the synchronous circuit actions are controlled by some asyn- 
chronous logic circuits which can stop the clock when certain delays are 
encountered in system functions, and then restart it. After the clock has 
been restarted, it runs at a constant rate. The design of synchronous 
circuits is somewhat more economical in equipment and lends itself 
more readily to the automatic checking features employed in this system. 

The logic circuitry of the central control is direct-coupled (de), that 
is, signals are represented by steady-state voltages. Two levels are em- 
ployed, one representing a binary 1 and the other a binary 0. The memory 
elements used are flip-flops with double-rail output signals to drive the 
logic circuits. A double-rail output is one in which both the logical 1 
and 0 conditions are represented by active signals on separate leads. 
Only one of the two leads, however, has an active signal at any time. 
The use of de circuitry avoids a design problem implicit in ac circuitry. 
In order to obtain the AND function in an ac system, precise coincidence 
is required of pulses applied to an AND gate. Since delays are encoun- 
tered as a pulse progresses through the logic, the design of circuits which 
will cause all pulses to be propagated to the right place at the right time 
can be quite complex. In order to make signals coincide exactly in time, 
extensive use of precision delay apparatus and multiphase clocks is gen- 
erally required. The ac system also lacks a certain amount of flexibility, 
since the addition of any function generally requires the overhauling of 
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other sections of the logic in order to maintain the proper signal coordina- 
tion. With de circuits, on the other hand, unequal chains of logic may 
exist with no particular problems. Since both flexibility and economy 
are of importance in an electronic switching system, the de mode was 
chosen. 

To a major degree, the advent of electronic switching was made possi- 
ble by the invention of the transistor and the refinement of other semi- 
conductor devices. The required logical functions are highly complex and 
necessitate thousands of active devices in the central control. Before the 
development of the transistor, hot-cathode vacuum tubes were the only 
available active elements for use in high-speed switching systems. The 
inherently high-power-consuming vacuum tubes require relatively high- 
cost circuits for adequate reliability, and this makes the vacuum tube 
unsuitable for large-scale electronic switching applications. However, 
semiconductor devices of moderate cost have the high reliability, high 
speed and low power consumption required for large-quantity use in 
such systems. It is believed, from the evidence so far available, that the 
reliability of the transistor and semiconductor diode will be orders of 
magnitude better than that of vacuum tubes performing comparable 
functions. 

After deciding upon the use of semiconductor devices and synchronous 
de circuitry in the central control, several other general decisions remain 
to be made. It is possible, if one is not concerned with the amount of 
equipment involved, to reduce all information-processing circuits to two 
- tandem stages, an AND and an OR. However, two-stage logic is gen- 
erally nonminimal. The use of multistage logic results in a reduction in 
the equipment needed for simple circuits and in even greater savings in 
complex circuits. However, a longer time is required for the logic opera- 
tion, since information is passed through more stages and the delay 
time of the signals will increase with the number of stages. Greater at- 
tenuation of the signals also will occur. Therefore, in multistage logic 
an economic balance must be achieved between equipment savings and 
the cost of additional time. This balance limits the minimization of the 
logic circuits. 

Another approach which leads to a less costly design, although perhaps 
to more circuit elements, is the development of universal circuit pack- 
ages. The use of such universal packages in the central control is made 
possible by distributing amplification throughout the logic. These sub- 
jects are more fully covered in Sections III and IV. 

The use of these packages has allowed a separation between logical 
and circuit design. The building blocks can be treated as black boxes by 
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following a few simple interconnection rules, thus considerably reduc- 
ing the over-all design time. The circuits have also been designed to be 
consistent with marginal and diagnostic testing techniques developed 
for the system. 


II. SEMICONDUCTOR DEVICES 


Transistors and semiconductor computer diodes were specifically de- 
veloped for this electronic switching system. While the central control 
is the major user of these devices, they are also employed in large numbers 
in other portions of the system, such as the switching network and 
scanner. In order to develop units of high reliability and to obtain the 
economic benefits of high-level production, it was felt necessary to mini- 
mize the number of designs and codes for the system. Therefore, the 
device characterizations represent a compromise among all possible uses 
in the system and, as such, are not necessarily the best for any individual 
application. The over-all benefits obtained from a smaller number of 
codes, however, more than compensate for this disadvantage. 

The transistors employed in this electronic switching system are a 
complementary pair — an n-p-n and a p-n-p designed for medium power 
and relatively high-speed switching applications. The transistors are 
capable of dissipating 450 milliwatts in free air at 25°C without the 
use of an external heat sink. In general, the logic circuits use the tran- 





Fig. 1 — Germanium alloy junction transistor for electronic switching system 
central control. 
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TasBLe I— TRANSISTOR CHARACTERISTICS 











Limits 
Parameter 
n-p-n Transistor p-n-p Transistor 

Collector breakdown voltage 30 volts min. 30 volts min. 
Emitter breakdown voltage 25 volts min. 25 volts min. 
Teo at 15 volts (25°C) 35 wa max. 15 wa max. 
Punch-through voltage 25 volts min. 25 volts min. 
Common emitter current gain 

I, = 25 ma; V, = 1 volt de 50 min. 50 min. 

I, = 150 ma de; Ve = 1 volt de 25 min. 25 min. 
Collector capacitance at 4.5 volts 45 puf max. 45 ppf max. 
Inverse gain bandwidth (IGB) 0.25 usec/cycle 0.25 usec/cycle 

max. max. 
Power dissipation, free air 25°C am- | 450 mw 450 mw 
bient 








sistors well below their power rating in order to obtain satisfactory sys- 
tem reliability. Fig. 1 is a photograph of the transistor, and Table I lists 
its important electrical characteristics, for both n-p-n and p-n-p. 

These characteristics are self-explanatory except for inverse gain 
bandwidth (IGB). This is a measure of switching speed and is related to 
the normal fo measurement for transmission applications. The main 
difference between the transmission and switching fields lies in the con- 
ditions of operation. In the transmission field (for other than power 
amplifier applications) a bias point is chosen and small excursions are 
made around this point. In the switching field, the whole operating re- 
gion is traversed, and the effective values of the parameters are obtained 
by integration over this region. Although the parameter anw, , the 
gain-bandwidth product of the transistor, is useful in both fields, in 
transmission this parameter is a function of the chosen bias point, while 
in switching this parameter is a weighted average taken over the whole 
range of bias points traversed, and properly should be labeled anwn . 

A corresponding method of measurement must be chosen, such as 
putting the transistor in a standard switching circuit and arranging to 
measure anwn - One way this can be done is to compare the output wave- 
form in a sufficiently low-impedance circuit with a waveform derived 
from a simple RC integrating circuit. The low-impedance circuit elim- 
inates effects of collector capacitance; the use of the same voltage supply 
cancels the effect of voltage variations. 

It can be shown that the quantity anw, is inversely proportional to 
the RC product if the initial slopes of the rise portions of the pulses at 
the outputs of the transistor and RC circuits are matched. In the actual 
measuring apparatus, a further factor of 27 has been introduced and 
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Fig. 2 — Germanium point-contact diode for electronic switching system cen- 
tral control. 


the quantity 1/anf. 1s read directly. This is called the inverse gain- 
bandwidth product or IGB and is measured in microseconds per cycle. 
Where a, & 1, as it is for these transistors, IGB is approximately equal 
to 1/fa . Therefore, the upper limit of IGB, 0.25 microsecond per cycle, 
roughly corresponds to an average f, over the active region of 4 mc 
minimum. 

Two codes of semiconductor computer diodes have been developed for 
the logic and switching circuits. Both are glass-enclosed, hermetically 
sealed, point-contact germanium diodes (Fig. 2). One of these units has 
a higher forward conductance and is used in AND gates, where the series 
voltage drop is of more importance. The other diode has better reverse 
characteristics and is used in OR gate applications, where the effect of 
leakage currents has a greater effect on circuit operation. Both diodes 
have maximum ratings of 100 ma steady-state (de) forward current with 
a peak surge-current limit of 500 ma. The maximum inverse working 
voltage is 100 volts. Maximum power dissipation at an ambient tempera- 
ture of 25° C is 200 mw, with a derating factor of 8 mw per degree C 
for ambient temperatures above 25°C The other relevant characteristics 
of these diodes are given in Table IT. 


II. TYPES OF SEMICONDUCTOR LOGIC CIRCUITS 


There are two general requirements which must be placed on a logic 
gate. The first is that the state of the output of the gate must depend in 
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TABLE II — DitopErE CHARACTERISTICS 








Electrical Requirements at 25°C Code 1 Code 2 
Max. forward voltage drop at 20 ma 1.5 volts 1.2 volts 
Max. reverse current at —5 volts 2.2 wa 4.5 pa 
Max. reverse recovery time 0.06 usec. 0.06 usec. 
Max. inverse voltage 100 volts 100 volts 





some logical sense on the states of the inputs. The second is that each of 
the inputs must remain free to change state independently of the states 
of the other inputs, i.e., the logic gate must maintain isolation between 
the inputs. 

It is convenient to classify the various methods of constructing physi- 
cal embodiments of logic gates in terms of the devices used to obtain the 
isolation of inputs. These devices constitute a very large percentage of 
the equipment required for a logic system, since at least one device is 
required per input. There are two common methods of obtaining this 
isolation in semiconductor logic circuits, one using diodes and the other 
using transistors. These are referred to as diode logic and transistor logic 
circuits. 

Diode logic circuits have been chosen for use in the central control. 
This decision was reached because semiconductor diodes at the present 
time are considerably less expensive than transistors, are capable of 
operating at higher speeds, and have achieved better reliability. The use 
of transistors in the central control has been restricted to amplification 
and memory functions, so that approximately seven times as many 
diodes as transistors are used. 


IV. DIODE GATES 


- Two-input conventional diode AND and OR gates are illustrated in 
Fig. 3. Additional inputs could, of course, be added. The logical function 
performed by each of these circuits depends on whether the high signal 
voltage (Vi) or the low signal voltage (Vo) is considered to be the active, 


V+ 
R 
| ai 
Vo Ro 


(a) | (b) yt 


Fig. 3 — Conventional diode gates: (a) AND gate; (b) OR gate. 


1132 THE BELL SYSTEM TECHNICAL JOURNAL, SEPTEMBER 1958 


or 1 condition. These conventions are referred to as “positive” logic and 
“negative” logic respectively. In the central control, positive logic is . 
used, i.e., the higher voltage condition is considered the 1 state. It is 
obvious that, if this convention is adopted, the circuit in Fig. 3(a) per- 
forms an AND function, since the output will be clamped to the lowest 
input voltage and, hence, a coincidence of high signals is necessary at the 
inputs to give a high signal at the output. The circuit in Fig. 3(b) can 
be seen to perform an OR function, since the output voltage will be high 
if any input voltage is high. Note that the inputs in both circuits can be 
at either level, independent of the states of the other inputs, because of 
the nonlinear characteristics of the diodes. 

Tor reasons of economy, the central control uses multistage logic, i.e., 
many gates occur in tandem between the input and output of the system. 
Furthermore, the complicated logical functions to be performed often 
make it necessary for a gate to drive several other gates in parallel. This 
“branching” is commonly referred to as ‘fanout.” As will be seen below, 
these features of the central control greatly complicate the use of diode 
gates. 

A diode gate in a multistage logic circuit normally has its inputs driven 
by gates and its output used to drive a load consisting of other diode 
gates. In order to provide the desired output voltage and current levels 
when a gate is activated, it is necessary to select a resistor which will be 
the correct value for the particular load impedance which this gate must 
drive. In complex circuits such as the central control the selection of the 
proper resistor for each gate becomes a very complicated procedure. 
Also, many different types of gate designs are usually necessary.? This 
means that many different types of packages must be manufactured and 
many varieties of spare packages must be kept on hand for adequate 
maintenance. In addition, a single change may require redesign of sub- 
stantial parts of the logic. Thus, such a system is difficult to design and 
has serious economic disadvantages. 

Another factor makes the use of a multistage diode logic system unde- 
sirable. Since diode gates contain only passive elements, the logic signal 
is attenuated as it proceeds through tandem stages. To minimize this 
attenuation and to account for the signal power lost due to fanout, the 
impedance levels of the stages must be increased in successive stages. 
Thus, the problems of signal crosstalk and loss of high-frequency re- 
sponse due to stray wiring capacitance will increase in the later stages 
and can seriously limit the operating speeds of the system. 

The use of transistor amplifiers in conjunction with the diode gates 
alleviates many of these problems. Such amplifiers are used in the central 
control and make possible the use of standard gates (gates whose resistor 
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values need not be tailored to the application) to construct relatively 
low-impedance, high-fanout, multistage logic circuits. 

Amplification can be inserted into the logic chains at various points. 
It is possible to provide amplifiers either for each logic stage or only at 
other selected locations. In the central control, amplifiers are provided 
after every OR gate. In this particular system, many more AND gates 
than OR gates are required and thus fewer amplifiers are necessary if 
they are associated with OR gates. The use of amplifiers with every OR 
gate, rather than only in selected spots, makes possible the design of 
very flexible diode gates, as will be described below. This choice of ampli- 
fier location results in two stages of logic (one AND-OR cycle) between 
amplifiers, although several AND gates can be used in series, as can sev- 
eral OR gates. 

The electronic switching system’s versions of the conventional diode 
gates of Fig. 3 are shown in Fig. 4(a). The resistor Ro on the conventional 
OR gate has been included in the amplifier which always follows an OR 
gate. The resistor R, of the conventional AND gate has been removed 
and has been replaced by individual resistors on each OR input. These 


V+i 


AND GATE OR GATE 





Fig. 4 — (a) Diode gates for central control; (b) interconnection pattern for 
diode gates. 
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individual resistors perform the same function as Ry but automatically 
give the correct equivalent resistance value for driving the load regard- 
less of the degree of fanout. This is illustrated in Fig. 4(b). If a single 
resistor R4 were used, its value would necessarily be changed for different 
numbers of loads on the AND gate in order to provide efficient amplifier 
operation. The slight extra cost of the added resistors is more than com- 
pensated for by the increased ease of design, the reduction in the number 
of types of packages and the increased efficiency of the amplifiers. 

The use of the individual OR input resistors also makes possible the 
use of a very efficient decoupling gate. The necessity for such a gate can 
be seen by considering Fig. 5(a). When two or more OR gate inputs are 
activated from a common point, the input current which each load will 
receive depends on the relative input impedances and threshold voltages 
of these loads. For instance, if Ra < Rp and V4 < Vg, load A will re- 
ceive most (or all) of the current from both input resistors A and B. 
The use of the decoupling gate [see Fig. 5(b)] prevents the flow of current 
between the input gate resistors A and B, and thus insures that each load 
will get the total output current of its associated gate resistor regardless 
of its input impedance or threshold voltage. The OR gate loads are al- 











(a) LOAD B 





Fig. 5— (a) Drive distribution problem; (b) use of decoupling gates. 
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ways transistorized packages in the central contol. The use of the de- 
coupling gate allows the design of low-input impedance transistor circuits 
for maximum efficiency of operation and also allows the use of different 
input thresholds if desirable. 

From Fig. 4(b) it can be seen that AND gates can be used in series 
without affecting the correct operation of the system. Also, OR gates 
can be used in series if input resistors are used only on the first stage. 
The use of gates in this fashion is often desirable to save diodes and is 
permitted in the central control, although it increases the logic signal 
voltage loss and, therefore, increases the voltage gain required of the 
amplifier. 

The operating currents and voltages for the circuits must be deter- 
mined before a decision can be made on the maximum number of OR 
inputs to be allowed. To be able to select operating currents and voltages, 
it is necessary to make engineering estimates of the effects of these levels 
on device and circuit reliability, operating speed and economy. In this 
system, the characteristics of the transistors and diodes are quite in- 
fluential in the selection of operating levels. The OR gate currents are 
roughly 5 ma and the maximum transistor currents are 100 ma. The 
maximum reverse voltages applied to devices are less than 20 volts for 
diodes and well below the breakdown voltages for transistors. These 
levels allow the devices to be operated well within their ratings to insure 
long life. The resulting impedance levels are low enough to obtain suffi- 
cient switching speeds and tolerable crosstalk levels. 

A limit of 20 inputs has been placed on the OR gate. This is necessary 
because the leakage currents through the diodes of all inactivated inputs 
will subtract from the current supplied to the amplifier by the activated 


(M-1)+(N-1) S 20 
MAXIMUM NUMBER OF INPUTS = MN 






M 
INPUTS 


N 
INPUTS 





Fig. 6 — Use of series OR gates to extend the number of inputs. 
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input. By the use of OR gates in series, larger numbers of inputs can be 
obtained without increasing the number of shunting diodes. An example 
of how this can be done is shown in Fig. 6. 


V. FACTORS IN THE DESIGN OF TRANSISTOR CIRCUITS 


In the design of de transistor amplifiers for logic circuits, it is conven- 
ient to use the transistors as switches. By utilizing the nonlinear charac- 
teristics of a transistor switch, many of the adverse effects of device 
parameter variation on correct amplifier operation can be greatly re- 
duced. Before proceeding with the description of the actual circuit de- 
signs, some of the basic large signal properties of junction transistors 
will be summarized. 

The use of a transistor as a switch? is illustrated in Fig. 7. From the 
characteristic curves it can be seen that the transistor can operate in one 
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Fig. 7 — Transistor switch. 
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TaBLe [II] — Larce-SigNaL Properties oF JUNCTION TRANSISTORS 
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Current gain No Yes Yes 

Voltage gain Yes Yes No 

Inversion No Yes No 


of three distinct regions. The region can be controlled by changing the 
input signal applied to the base. In region I, both collector and emitter 
junctions are reverse-biased and the transistor will be cut off, i.e., the 
impedance from collector to emitter will be very high. In region II, the 
active region, the emitter junction is forward-biased and the collector 
junction is reverse-biased. In region III, both junctions are forward- 
biased and the transistor switch will be closed. In this region the transis- 
tor is said to be in saturation and the impedance from collector to emitter 
will be very low. 

The transistor switch described above is an example of the common 
emitter configuration. In this configuration the transistor exhibits both 
current and voltage gain and for this reason it is the most commonly 
used connection. The common emitter connection also provides signal 
inversion. 

The general properties of the two other possible configurations are 
shown in Table JII. The direction of currents and the polarity of the 
biasing voltages in Fig. 7 and Table III are for n-p-n transistors and 
should be reversed when p-n-p transistors are being considered. 

In the design of de transistor circuits, it is often useful to know the 
general relationships between the input voltage levels necessary to switch 
a transistor from cutoff to saturation and the resultant output voltage 
levels. These characteristics for the three configurations are shown in 
Fig. 8 for both n-p-n and p-n-p transistors. The waveforms represent the 
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Fig. 8 — Input-output voltage relationships of various junction transistor 
configurations. 


voltages which appear directly on the transistor terminals; Vp and Vr 
are the reverse and forward biases on the base-emitter junction and V* 
is the reverse bias voltage which will appear across the base-collector 
junction if the transistor is not allowed to saturate. The usefulness of 
these characteristics is illustrated in the design of the gate amplifier in 
Section VI. 

The switching speeds of transistors are important in nearly all applica- 
tions, especially in the circuits for the central control. While these speeds 
depend mainly on the transistor parameters, it is possible to maximize 
them by suitable circuit design. Analytical studies of the switching times 
of junction transistors have been made by Moll! and have been extended 
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by Easley® to include the effect of collector capacitance. The results of 
these studies are quite useful in determining the relative effects of 
transistor and circuit parameters on speed. The discussion here will be 
limited to the common emitter configuration, but the results are quite 
similar for all configurations. 

The basic common emitter circuit analyzed by Moll and Lasley is 
shown in Fig. 9, together with waveforms illustrating the currents and 
switching times of interest. Here, 7'o is the rise time and 7» is the fall 
time. The delay caused by carrier storage if the transistor is allowed to 
saturate, 7; , will be discussed below in more detail. The maximum value 
of the collector current, J¢1, will be approximately equal to Vec/Rz if 
the transistor is driven into saturation. 

The above-mentioned studies!: > show the expression for the rise time 
to be 





1 1 + Walt iC e Ta 
nea a le ae 2) 
is <a Im — 0.9 (=) en 


where 


a common base short-circuit current gain, 
w, = alpha cutoff frequency in radians/sec, 
Ce = collector junction depletion layer capacitance. 


This equation is plotted in Fig. 10 to illustrate more graphically the ef- 

















Fig. 9 — Transient behavior of common emitter junction transistor stage. 
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Fig. 10 — Plot of equation (1). 


fects of variations in device and circuit parameters. The quantity w, in 
Fig. 10 represents the reciprocal of the effective time constant of the 
circuit, 1.e., 

We 


ee en ee 


From Fig. 10, it can be seen that the rise time can be improved by in- 
creasing w; and a and by decreasing the actual circuit gain, I¢/Ip1 . 
Thus, given a specific transistor, the rise time can be improved by sacri- 
ficing circuit gain and by operating the circuit at low enough impedance 
levels to make w; & wy . A further advantage of operating with low circuit 
gain is that the rise time will be little affected by changes in a which 
occur due to transistor aging. For circuit gains which are small compared 
to the possible gain, (1) can be reduced to 


Ty ~ 0.9 Ta (1 + Welt iC) 
eee —_—__—_—_———_. 
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Refs. 4 and 5 give the following expression for the fall time: 
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A plot of this equation would be quite similar to that in Fig. 10, where 
the forward current gain J ¢/Jz; is replaced by the reverse current gain 


Ie 
to’ 
Igo + i= 2) 


a 

Thus, the fall time can be improved in the same general way as the rise 
time. For the case where the transistor is heavily overdriven, equal rise 
and fall times are obtained when J,; and J2 are approximately equal. 

When a transistor is operated in region III (saturation), more minority 
carriers are present in certain regions of the transistor than the number 
which must be present in these regions when the transistor is operated 
in region II. Before the transistor can be switched from region III to 
region II, these excess carriers must be removed. While they are being 
removed the transistor will continue to operate in region IIT and the out- 
put current will change only slightly. This effect, called storage, results . 
in a true delay between the time the input current is changed and the 
time when the output current begins to respond. For transistors such as 
those described in Section IT, this delay may be as long as microseconds— 
much too long to be tolerated in most circuits. Special antisaturating 
circuits have been developed which prevent the transistor from saturat- 
ing but still permit overdrive for fast rise and fall times. These techniques 
are illustrated in Section VI. 


VI. BASIC BUILDING-BLOCK CIRCUITS 


In the earlier sections the philosophy of using as few types of circuits 
as possible has been explained. The basic AND-OR diode circuits, which 
constitute a large percentage of the total number of circuits used, have 
already been discussed. The need for transistorized circuits to perform 
the memory function and to provide gain was also established. In this 
section transistor circuits will be discussed. 


6.1 Gate Amplifier 


The exact nature of the circuit used to provide the gain within the 
logic is determined by requirements and limitations imposed by the 
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type of logic and the parameters of the available transistors. The major 
requirements of the amplifier are: 

1. The amplifier must have sufficient current gain to satisfy the fan- 
out occurring at most OR gates. To provide enough gain to satisfy the 
worst case would be costly, since the number of large fanout points is 
relatively small. An available gain of six is sufficient to satisfy approxi- 
mately 85 per cent of the applications. This rather modest current gain 
requirement can drive fanouts which appear much larger, as can be 
understood by reference to Fig. 11. In Fig. 11 amplifier G is shown driv- 
ing inputs ton AND gates which control, in turn, m OR gates (m being 
greater than n). Since the amplifier shares the load of any AND gate 
with all the other passive (low-voltage state) inputs, the load on G is 
not equal to the sum of the currents in the AND gates. Therefore, where 
large fanout situations arise, known functional relationships between the 
inputs to the AND gates often make it possible to have effective fanouts 
of much greater than six. The nature of the logic in the system favors 
this condition. 


OR GATES 





AND GATES 


Fig. 11 — Fanout from an amplifier. 
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TasBLEeE IV — Properties oF ONE- AND T’'wo-STAGE dc-COUPLED 
AMPLIFIERS 








Circuit Configuration 




















' Amplifier Requirement One Stage Two Stages 
CB CC CE | CB-CB | CB-CE | CB-CC | CE-CC | CE-CE | CC-CC 

Current Gain No Yes | Yes | No Yes | Yes | Yes | Yes | Yes 
Voltage Gain Yes | No | Yes | Yes | Yes | Yes | Yes | Yes | No 
No Inversion Yes | Yes | No Yes | No Yes | No Yes | Yes 
Voltage No | Yes | No | Yes | Yes | Yes | No | Yes | Yes 

“Straddling”’ (?) 

CB Common base 


CE Common emitter 
CC = Common collector 


2. The amplifier must have sufficient voltage gain to cancel the loss in 
the AND and OR gates and thus re-establish voltage levels. The AND 
gate diodes attenuate the passive-state signal level, while the OR gate 
diodes attenuate the active-state signal level. For these reasons the 
amplifier must provide gain about the center line of the de input in both 
the positive and negative directions. Thus, the output voltage levels 
must “straddle” the input voltage levels. | 

3. The amplifier must be noninverting and dc-coupled. 

4. The amplifier must be fast enough to allow the use of up to three — 
amplifiers in a series logic chain. For the transistors employed, this re- 
quires nonsaturating, low-gain circuits. 

In order to select the best circuit configuration to meet these require- 
ments the properties of the three basic transistor configurations must be 
considered. These were discussed in Section V. The relatively modest 
current and voltage gain requirements of the amplifier make it evident 
that no more than two transistor stages should be necessary. The per- 
tinent de properties of all possible configurations of one- and two-stage 
amplifiers are listed in Table IV. From this table it may be seen that no 
one-transistor configuration meets the de requirements of the amplifier. 
Of the two-transistor configurations only the common-base-common- 
collector and the common-emitter-common-emitter combinations meet 
all the requirements. A closer examination of the common-base-common- 
collector configuration reveals that some sort of passive voltage-shifting 
network would be necessary to meet the straddling requirement. In addi- 
tion, in this configuration the common base transistor would have to 
furnish all the voltage gain and the common collector all the current gain. 
The two common emitter stages constitute the best configuration, since 
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each provide both current and voltage amplification and the combina- 
tion satisfies the remaining requirements. From Fig. 8 it can be seen that 
one transistor must be an n-p-n and the other a p-n-p to obtain voltage 
straddling. Since the signal is inverted in each stage, the two transistors 
will be either both ON or both OFF. An input to the first transistor of a 
polarity to turn it ON, for example, will, when inverted, turn ON the 
second stage of the amplifier. 

The only decision remaining in determining the configuration is to 
establish the order in which the transistors should appear. The diode 
logic demands that the amplifier output provide a current path to ap- 
proximately ground potential in the passive state and a high impedance 
in the active state. Two possible types of amplifiers exist, corresponding 
to the two possible methods of connecting the transistors. In the positive 
logic system, placing the n-p-n first and the p-n-p second leads to a 
“make” type amplifier; the reverse order produces a “break” type ampli- 
fier. These two types are shown symbolically in Fig. 12, along with the 
corresponding transistor circuit configurations which realize them. In 
the break amplifier both transistors would be ON in the passive state 


SYMBOLIC TRANSISTORIZED 


Zz |D 


Vt 





z|D 








BREAK AMPLIFIER 


Fig. 12 — Possible amplifier configurations. 
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and OFF in the active state. The conditions would be reversed in the 
case of the make amplifier. 

The choice between the two basic types of logic amplifiers above is not 
a simple one. The few apparent advantages of one over the other almost 
vanish when detailed final designs are approached. For example, the 
make amplifier appears much less efficient. In addition to supplying the 
full passive load current in the resistor to — V at the output of the ampli- 
fier it must supply enough extra current to raise the output voltage to 
the active signal level. However, the need for dummy loading the break 
amplifier to compensate for stray wiring capacity in the system, as will 
be discussed below, almost nullifies this apparent advantage. 

The decision as to which amplifier to choose must rest upon more 
subtle differences. The more important of these, leading to the choice 
of the break-type amplifier, are: 

1. To stabilize the passive voltage level at the output of the make 
amplifier a diode clamp is required. This is a factor in reliability and 
introduces delay, since the current in the clamping diode must be re- 
placed by current from the amplifier before any change in output voltage 
can occur during a transition from the passive to the active condition. 

2. The make amplifier has a definite maximum current capacity and 
must switch this amount regardless of the load. (The diode clamp com- 
pensates for varying load conditions.) This necessitates an exact calcu- 
lation of the maximum load on a particular amplifier. No such limitation 
exists in the case of the break amplifier, as will be developed later. 

In addition to meeting the initial requirements in the system, the gate 
amplifier must have sufficient margin to function reliably as the com- 
ponents age. The most critical components in the circuit, and those for 
which the least aging information is presently available, are the tran- 
sistors and diodes. A brief summary of the expected behavior of the most 
significant parameters is given below: 


Transistors 


1. Frequency cutoff of a, (f.): This parameter is related almost ex- 
clusively to the internal geometry of the transistor and the physical 
constants related to transistor action. Therefore, no significant change 
should occur. 

2. Transistor a: Experience has shown that a tends to age downward 
initially after which time it stabilizes. In all the designs an a of 0.94 was 
assumed as a reasonable minimum. 

3. Transistor saturation current, Ico : Almost without exception, I¢o 
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in transistors ages upward. In circuits which are sensitive to this param- 
eter a maximum of 200 microamperes was assumed. 


Diodes 


1. Diode forward voltage drop: Previous experience with germanium 
point-contact diodes similar to those to be used in the system indicates 
little or no change with time. 

2. Diode reverse leakage current: Diode reverse current behaves simi- 
larly to Ico in transistors except that its behavior is somewhat dependent 
upon the voltage at which it.is measured. At low voltages (5 volts or 
less) it often ages downward. At higher voltages the trend is upward. 





Fig. 13 — Nonsaturating amplifier. 


In the discussion of the AND and OR gates in Section IV the current 
level in OR gates was stated as approximately 5 ma. In the passive state 
this current is shunted through one or more AND gates by one of the 
several types of amplifiers in the system. In the active state the shunt 
path through the AND gates is interrupted by the amplifier going OFF. 
Under this condition the OR gate current drives forward to turn OFF 
the succeeding amplifier stage. To operate properly the amplifier must, 
therefore, have an input voltage threshold higher than the total voltage 
drop in the AND gates preceding the OR gate plus any drop in the 
preceding amplifier in its passive state. From these considerations, the 
input threshold of the amplifier has been set at +6.5 volts. Having al- 
ready established the output of the amplifier to be approximately ground 
in the passive state, we can choose the other voltages to provide the de- 
sired impedance level and current drives. 

In Fig. 18 the break amplifier is redrawn with some complexity added 
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to prevent the transistors from saturating and to establish the proper 
threshold. With no input to the amplifier (the input OR gate shunted 
down) the amplifier must assume its passive condition (both transistors 
ON). This requires that Vez be greater than the +6.5 volts which estab- 
lishes the input threshold. The output current of Q: and thus the drive 
to Qe , will be approximately 


Vur a, 6.5 a 
Re 1° 


This current can be set by considering the input drive available and the 
required output current. Since the input must rise above Vuz in the 
active state to turn off Q,, the quantity (Vze — 6.5) should be kept 
small. This leads to the choice of Vzz = +8 volts in the system. 

In order to establish the internal current drives of the amplifier, the 
actual transistor gains must be calculated. The 5 ma current level in 
the OR gate is not all available to turn OFF the first transistor, Q,. 
When the drive is removed from the input, the amplifier must return to 
its passive condition. Since both the active and passive states are equally 
important in the de double-rail logic, this transition must be as fast as 
the transition from passive to active. A bias current drive is provided - 
to establish the passive state when the input drive is removed. This bias 
reduces the forward drive when the amplifier is driven active. For equal 
turn-on and turn-off times, the bias current must be approximately one- 
half the input drive. This situation exists in both stages of the amplifier 
and, by itself, requires the combined transistor gain to be four times the 
apparent terminal gain of the amplifier. 

Because of the large physical size of the central control, an amplifier 
often must drive loads located a considerable distance away from it. 
Stray capacity on these leads delays the transition from the passive to 
the active state. This effect can be reduced by the addition of Rs. Cur- 
rent in this dummy load is available to charge stray capacity at the 
expense of demanding more gain from the amplifier. A dummy-load 
current of 8 ma was chosen as a reasonable compromise. The dummy 
load also provides a well-defined active voltage level at the output of 
the amplifier. 

By taking into account the current transfer loss of OR gates, the 
leakage currents of idle OR inputs and the dummy load, the combined 
transistor gain must be nearly 60 to realize the necessary terminal gain 
of six. This is accomplished by assigning a transistor gain of approxi- 
mately 7.5 per stage, making the switching speeds relatively independ- 
ent of a over the design range. (See Fig. 10). 
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By combining the information outlined above, the current level in 
R, can be set as (out max/7.5) = 5 ma. This requires approximately 10 
ma from Q; and a bias current to Q, of (10/7.5) = 1.3 ma. From these 
basically simple considerations, the resistors 2; , Re and R,4 can be speci- 
fied in terms of —V. The magnitude of —V can be set by considering 
the breakdown voltage ratings of the transistors and the current transfer 
efficiency in R; and R,. A value of —4.5 volts was selected. 

The remaining components of the amplifier of Fig. 13 are Dz, D3, D4 
and 23. Diodes D2 and D, limit the voltage swings at the transistor in- 
puts and reduce the effect of collector capacity by lowering the transient 





Fig. 14 — Gate amplifier. 


base impedances. Resistor 23 and diode D; combine to prevent saturation 
in transistor Q2. Having established the currents in Q,, R, and Qe, 
and knowing the range of values of a and Ico in Qe, we can determine 
the currents in R3; and Ds; under all conditions. If Rs is chosen so that 
its voltage drop is always greater than the voltage across D; when Qe 
is ON, Q: will never saturate. The advantage of this method of prevent- 
ing saturation is that diode D; shunts the excess drive to Q: only after 
the output voltage has completed its transition to the passive state. 

The final design of the amplifier is shown in Fig. 14. It differs from the 
previous drawing, Fig. 138, in the addition of capacitors C; and C2 and 
resistors 2, and I; . The capacitors C; and C2 do not affect the de condi- 
tions but do improve the transient response. In particular, the delay in 
the amplifier is reduced. 

Resistor R; and diode D, constitute a single input OR gate. This 
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allows the gate amplifier to be driven by AND gates if desired. An option 
is also provided at the output of the amplifier for connecting loads to the 
collector of Q2 directly or through R;. Loads drawn through R; cause 
the voltage at the output to increase with load. Thus, if amplifiers are 
sharing a load (as in the case of AND gates), the load currents of the 
individual amplifiers will tend to equalize. This is an essential condition 
for realizing large fanouts, as was explained in conjunction with Fig. 11. 

One of the advantages claimed for the break-type amplifier should be 
noted. Depending upon the a’s of the transistors and the delay which 
can be tolerated in a particular logic chain, an amplifier may carry con- 
siderably more current than the design maximum of 30 ma. In engineer- 
ing the logic of the central control, it becomes quite difficult to estimate 
the load current of each amplifier under all conditions of fanout. The 
break-type amplifier has margin for error when circuits are engineered 
to the design limit. This margin can also be of importance in locating a 
faulty amplifier under trouble conditions. Because of load-sharing be- 
tween amplifiers, the failure of one causes the load on associated ampli- 
fiers to increase. If the associated amplifiers are capable of absorbing 
this added current, the trouble condition can be traced to the particular 
faulty amplifier. Amplifiers of the make type, however, by virtue of their 
inability to absorb current above a designed maximum, could indicate 
multiple troubles where only one actually existed. 


6.2 Flip-Flop and Associated Circuits 


The transistorized memory element of the central control must meet 
requirements which cannot be stated as explicitly as were those of the 
gate amplifier. The requirements can be generally stated as: 

1. Stability: The flip-flop must maintain its bistability under all con- 
ditions of load, temperature and voltage encountered. 

2. Compatibility: The flip-flop must trigger from pulses readily 
available in the system, must not respond to noise in the system and 
must be capable of driving into the standard de double-rail diode logic. 

The configuration of the transistorized flip-flop differs only slightly 
from the conventional Eccles-Jordan type. The development of the 
design is similar to that of the gate amplifier and the same considerations 
regarding gain, speed, etc., also apply. For this reason, the details of 
design will not be considered. Instead, emphasis will be placed upon 
how the flip-flop fits into the general system and upon some of its major 
characteristics. 

The flip-flop used in the electronic switching system is basically a 
four-transistor circuit. The de bistability is provided by two of the tran- 
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sistors, which are combined on a single package designated the flip-flop. 
The other transistors comprise two single-stage amplifiers which afford 
buffering between the 1 and 0 outputs of the flip-flop and the external 
de logic that the composite flip-flop must drive. These amplifiers are 
designated the flip-flop to gate amplifiers. Special buffer amplifiers are 
provided for the cases where the flip-flop does not drive diode logic. All 
the amplifiers clamp the flip-flop output, this being essential in prevent- 
ing saturation. 

Fig. 15 shows the details of the flip-flop, with the buffer amplifiers 
simulated by resistor-diode clamps to ground. We shall consider the more 
important features of the circuit in turn. 

The use of separate terminals to introduce the collector supply voltage 
(—16 volts) provides a method of predetermining the state a flip-flop 
will assume when power is applied. By connecting the terminals to 
separate supply buses and momentarily connecting one to +16 volts 
and then to the normal —16 volts, the system will assume the state 
represented by the wiring pattern. 

The degeneration produced by the common emitter resistor stabilizes 
the voltage at the emitter node and the output current of the ON tran- 
sistor. This voltage stabilization of the emitters (and therefore of the 
base of the ON transistor), combined with the clamping action of the 
amplifiers in the collector circuit of the ON transistor, prevents satura- 
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Fig. 15 — Flip-flop with simulated amplifier loads. 
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tion in the flip-flop. The voltage and current levels are designed to pro- 
vide the same input. voltage threshold as in the gate amplifier. By de- 
signing the output current to equal that of Q; in the gate amplifier, it 
was possible to make the flip-flop to gate amplifier essentially the same 
as the output stage of the amplifier of Fig. 14. Thus, when viewed from 
its terminals, the flip-flop and its amplifiers together are exactly equiva- 
lent to the gate amplifier insofar as de conditions are concerned. 

Fig. 15 shows the use of standard OR gates for triggering. To pre- 
vent race conditions from occurring in the system, all inputs to the flip- 
flop are gated by the master clock. This requires that a clock signal be an 
input on all AND gates preceding OR gates driving a flip-flop. A single- 
input OR gate is provided on each side of the flip-flop to allow driving 
from AND gates if desired. 

Another feature of the flip-flop is the use of diodes between the bases 
and emitters of the transistors. These diodes limit the reverse bias on 
the transistors to a fraction of a volt, clamp the driving OR gate output 
and, most important, lower the transient impedance in the base circuit. 
The lower base impedance reduces the effect of collector capacity and 
improves triggering sensitivity. 

The circuits of the two buffer amplifiers are shown in Fig. 16. The 
amplifier used to drive logic gates, the flip-flop to gate amplifier, needs 
no explanation since it is almost identical to the output stage of the gate 
amplifier previously described. The flip-flop to relay amplifier is designed 
to drive the highly inductive loads of wire-spring relays. The transistors 
are allowed to saturate in this circuit because of the slow speeds involved. 
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Fig. 16 — Flip-flop buffer amplifiers: (a) flip-flop to gate; (b) flip-flop to relay. 
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Fig. 17 — Emitter follower circuit. 


6.3 LHmitter Follower 


In an earlier section, it was stated that the gate amplifier and the 
flip-flop to gate amplifier were not designed to have sufficient current 
gain to satisfy the points of largest fanout in the system. A special pack- 
age, the emitter follower, is provided to supply this extra gain. One gate 
amplifier can drive a maximum of four emitter followers in parallel. 
For even greater fanouts, emitter followers can be cascaded. The inclu- 
sion of an emitter follower adds almost no delay to a logic chain. The 
circuit of the emitter follower is shown in Fig. 17. 


6.4 Inverter Amplifier 


An additional circuit, shown in Fig. 18, which saves equipment in 
many applications in the system is the inverter amplifier. The terminal 
conditions of the inverter amplifier are similar to those of the gate 
amplifier except for the logical inversion and a lower load capability. 


OUTPUT 
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Fig. 18 — Inverter circuit. 
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The circuit is similar to the first stage of the gate amplifier, except for 
the use of an n-p-n transistor and different voltage levels. A Zener diode, 
DZ, , raises the input voltage threshold to the same level as that of the 
other transistor circuits. Diode Dz clamps the output of transistor Q, to 
prevent saturation. 


6.5 Cable Pulser 


The need for the central control to communicate with the electron 
tube circuits in other parts of the system requires special buffering 
amplifiers for transmitting high-speed signals over coaxial cable. These 
signals originate from OR gates in the central control. In addition to 
driving the cable, the OR gates must activate local flip-flops in the 
central control to retain a record of the information transmitted. The 
OR gate neither has sufficient current output to perform these two func- 
tions nor is its impedance compatible with that of the cable. The cable 
pulser circuit shown in Fig. 19 provides the required gain and achieves 
compatibility between the units. 

The cable pulser is a two-stage amplifier. The first stage is a common 
collector configuration which provides sufficient current gain to drive 
a flip-flop and the second stage of the cable pulser. The second stage is a 
common emitter configuration which provides voltage and current gain 
to drive the cable. The output is coupled to the cable through an imped- 
ance-matching transformer. The input to the cable pulser is gated by 
the master clock. 


6.6 Special Circuits 


Although every attempt has been made to minimize the number of 
types of packages in the system, in some cases the use of special packages 
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Fig. 19 — Cable pulser circuit. 
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is economically justifiable. In this system these special packages take 
the form of modifying networks which are used in conjunction with 
standard packages to realize special circuit functions. The circuits are 
shown in Fig. 20. 


6.6.1. Feedback Network 


Monostable flip-flops are required for timing applications in the sys- 
tem. This need has been satisfied by the design of a simple feedback 
network for use with the standard gate amplifier, consisting simply of a 
resistor and a capacitor in series. When connected between the output 
and input of a gate amplifier, the network provides positive feedback 
for a time determined by the values of the resistor and capacitor. The 
purpose of the extra resistor in the feedback network is to provide a 
voltage step at the output of the amplifier at the beginning of the timing 
cycle. If the load on the circuit is coupled through an AND gate, this 
step is sufficient to decouple the load during the timing cycle and, there- 
fore, make the timing independent of load. 


6.6.2. Pulse-Shortening Network 


Occasionally the need arises in the system to derive a narrow (approxi- 
mately 1-microsecond) pulse from the output of one of the standard 
amplifiers. This has been accomplished by a simple network consisting 
essentially of a shorted 0.5-microsecond delay line which can be con- 
nected to the output of an amplifier. As shown in Fig. 20(b), a resistance 
divider network is needed to derive a clamping voltage level approxi- 
mately 2 volts above ground to prevent saturating the driving amplifier. 
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Fig. 20 — Special network circuits: (a) monostable feedback network; (b) 
pulse-shortening network. 
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The resistor 22, and inductor Z, provide a current step to the network, 
thus giving a better-shaped pulse in the output. 


VII. MECHANICAL DESIGN | 


In the semiconductor circuitry of the electronic switching system, a 
modular approach to mechanical design is used. This is in keeping with 
the universal building block approach to obtain economy in both manu- 
facture and in the number of spare packages required in the telephone 
central office. It is also consistent with the marginal and diagnostic 
trouble-detecting techniques developed for the system, whereby faulty 
equipment can be easily replaced. 

The semiconductor circuits used in this model of the electronic switch- 
ing system are placed on printed wire boards. A board may contain one 
or more circuits, depending on the degree of complexity and the num- 
ber of components employed in the individual circuits. Fig. 21 illustrates 
the basic board assemblies. On both sides of the transistor end of the 
board (and only on those boards containing transistors) is a series of 
terminals designated shorting plug terminations. These are provided 
so that the transistors may be tested, external to the circuit environ- 
ment, without unsoldering any leads or physically disturbing the tran- 
sistor in any way. In normal use the transistor is connected into the 





Fig. 21 — Printed circuit boards and components. 
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Fig. 22 — Printed board, shorting shoe and connector. 





Fig. 23 — Coded connector for semiconductor package. 


circuit by means of a shorting plug. Fig. 22 illustrates the use of the 
shorting plug and also shows the board terminations and connector. One 
can also see in Fig. 22 that each card assembly is coded on a 3-slot-out- 
of-a-possible-11 basis. The connector is similarly coded with barriers or 
teeth so that one particular type of card will fit into a companion coded 
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Fig. 24 — Representative portion of circuit schematic. 
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Fig. 25 — Equipment unit (front). 


connector. This will prevent improper interchange of packages during 
assembly or maintenance. 

As shown in Fig. 21, each component is fastened over the edge of the 
card by a clinch which mechanically holds it in position. A subsequent 
solder dip secures the mechanical clinch and at the same time makes the 
electrical connection to the printed wire circuit. The component lead 
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makes an edge connection from one side of the board to the other if this 
is required. This method of mounting the components lends itself to low- 
cost automatic manufacturing techniques. 

The connector shown in Fig. 22 is a reliable contact connector that 
can be produced and assembled by automatic or semi-automatic ma- 
chinery. It is held together by spring clips, which also hold the connector 
in the mounting plate. Fig. 23 shows the connector and its component 
parts in more detail. 

Fig. 24 is a portion of a circuit schematic showing the use of AND and 
OR gates, amplifiers and flip-flops. Circuitry of this type is developed 
into equipment as shown in Fig. 25. The gates, amplifiers and flip-flops 
are arranged for ease of maintenance, ease of manufacture and for proper 
circuit operation. In this equipment connectors are placed in the mount- 
ing plates and the mounting plates are arranged in groups and wired. 
The printed wire board assemblies are plugged into the connectors. The 
fronts of the boards are supported and aligned by means of a bar ar- 





Fig. 26 — Equipment unit (rear). 
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ranged across the front of the framework, with the front edge of this bar 
also serving as a designation strip. Fig. 26 shows the rear of the equip- 
ment. Solderless wrapped connections are used exclusively, and the 
equipment can be automatically wired by programmed solderless wiring 
machines. 


VIII. CONCLUSION 


The philosophy of semiconductor circuit design for the central control 
of an electronic switching system has been described. The primary em- 
phasis in the design has been on low cost consistent with good margins, 
reliability and the meeting of all systems requirements. 

The general-purpose nature of the building blocks affords great 
flexibility to the logic designer in implementing complex system func- 
tions. The ability of the circuits to handle widely varying loads allows 
the system to be engineered quite simply. An effort has been made to 
minimize the number of package types consistent with the many differ- 
ent functions to be performed. This results in economy in manufacture 
and maintenance. 

The use of antisaturating low-gain circuits, clamping iehnigues and 
careful equipment design has resulted in operating speeds sufficient for 
the desired rate of information processing. Throughout the designs, gen- 
erous allowances have been made for aging and variations in device and 
component parameters to assure high reliability consistent with economy. 
It.is too early to give an accurate evaluation of the true reliability of the 
circuits, since this can only be obtained by relatively long field experi- 
ence. However, present indications are that these circuits will result in a 
system furnishing service at least comparable with present-day electro- 
mechanical systems. 


Ix. ACKNOWLEDGMENTS 


The authors wish to express their appreciation for the contributions 
to this project made by their many co-workers. In particular, we wish to 
thank S. H. Washburn for his guidance and helpful comments. 


REFERENCES 


1. Joel, A. E., this issue, pp. 1091-1124. 

2. Yokelson, B. J. and Ulrich, W., Engineering Multistage Diode Logie Circuits, 
Comm. and Electronics, no. 20, September 1955, pp. 466-474. 

3. Ebers, J. J. and Moll, J. L., Large- Signal Behavior of Junction Transistors, 
Proc. LR.E., 42, December 1954, pp. 1761-1772. 

4, Moll, J. L., Large- Signal Transient Response of Junction Transistors, Proc. 
LR.E., 42, December 1954, pp. 1773-1783. 

5. Easley, ae W., The Effect of Collector Capacity on the Transient Response of 
Junction Transistors, I.R.E. Trans., ED-4, January 1957, pp. 6-14. 


Fundamental Concepts in the Design of 
the Flying Spot Store 


By C. W. HOOVER, JR., R. E. STAEHLER and 
R. W. KETCHLEDGE 


(Manuscript received May 15, 1958) 


The flying spot store is a semipermanent information storage system de- 
veloped for use in an electronic switching system which utilizes cathode ray 
tube access to information stored on photographic emulsion. Parallel optical 
channels are used to provide high capacity and parallel readout. A feedback 
system provides rapid and precise beam positioning for writing and readout. 
This paper describes the fundamental design considerations for memory 
systems of this type, stressing physical realizability, speed, capacity and 
other system features. The characteristics of a laboratory model are presented. 


I. INTRODUCTION 


1.1 Application in Electronic Switching Systems 


The flying spot store has been developed to meet the needs in electronic 
telephone switching systems for high capacity semipermanent memory 
arranged for rapid random access to stored words. In its present form the 
flying spot store meets all the requirements of the system described else- 
where in this issue.! The original suggestion for the use of a flying spot 
store was made by C. E. Brooks, leading to the development described 
in this paper. 

Electronic switching systems of the future will also require memory of 
this type. Directory-to-equipment number translations alone will re- 
quire millions of bits. In the form now under development, the flying 
spot store appears capable of meeting the memory requirements of these 
large systems. 


1.2 Form of the Flying Spot Store 


In the flying spot store information is stored as a pattern of trans- 
parent and opaque spots on developed photographic emulsion. Access 
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for writing and reading is gained by means of a number of light beams 
generated by a single cathode ray tube and an array of objective lenses 
operated in parallel, each imaging the working area of the cathode ray 
tube face on a separate photographic area. A photomultiplier detector 
is located behind each area. One bit of each word is placed at the same 
address position, on each of the storage areas. In the laboratory model 
described each of these areas is on a separate photographic plate. A single 
access operation, i.e., beam positioning, therefore results in readout of a 
number of bits in parallel. In the usual instance, this number can be 
made equal to the word length. 

Beam position is controlled by a closed-loop feedback system de- 
veloped especially for this purpose. A number of the parallel optical 
channels contain code plates. The bar patterns on these code plates are 
chosen so that readout from these channels gives the cartesian coordi- 
nates of the beam position at all times in parallel binary form. 

An error signal is derived by the comparison of this position readout 
with the required address position in a parallel digital comparator. The 
signal is applied to integrating and deflection amplifiers in tandem to 
drive the beam to within one spot diameter of the required position. 
Once within this area, the beam is locked by linear servo action to the 
single code-plate edge passing through the center of the cell at the ad- 
dress selected. 


1.3 Harly Work on Photographic Storage Systems 


The basic idea of light-beam access to information stored on photo- 
graphic emulsion is not new. It has been known for a long time that stor- 
age densities as high as 10° bits per square millimeter can be obtained on 
emulsions.? With the incentive of low-cost high-capacity memory, many 
proposals were advanced in the literature for light beam access systems. 
King, Brown and Ridenour describe many of these proposals in an early 
survey article.* These early systems used only one source, objective lens 
and photodetector, and differed principally in means of access. Access 
was provided either by positioning a cathode ray tube beam or by me- 
chanically addressing the point on the storage plane between fixed light 
source and detector. 

Systems using the cathode ray tube or flying spot scanner type of 
access offered the possibility of rapid random access. However, in pro- 
posed systems of this type, the cathode ray tube and lens were operated 
at extremely high resolution in order to provide enough total capacity 
to make the system useful. This imposed requirements upon the devices, 
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upon mechanical positioning tolerance and particularly upon the beam- 
positioning system which were extremely difficult to meet. 

Systems using mechanical selection in whole or in part offered the possi- 
bility of high capacity but suffered from the slow sequential access dic- 
tated by the mechanical addressing arrangement. 

For these reasons, neither type of system could have been used to sat- 
isfy the memory requirements of the electronic switching systems of the 
type now being developed. 


1.4 The Analog Accuracy Problem 


All of the early proposals for the flying spot scanner type of access 
recognized the severe difficulty in obtaining the required analog accuracy 
in beam positioning. In addition, our studies have shown that it is desir- 
able to position the reading beam within -+£0.1 spot diameter of the center 
of the written spot. Less precise positioning would degrade the discrim- 
ination ratio or force a reduction in capacity. In an analog beam position- 
ing system used to establish an array of 500 X 500 spots at the cathode 
ray tube, the accelerating voltage supply for the cathode ray tube and the 
deflection amplifier power supply would have to be regulated to within 
+0.02 per cent to maintain this position accuracy. Similar close require- 
ments would appear at many other points in the system. 

For these reasons, it has been a fundamental premise that beam posi- 
tioning would be controlled by a closed-loop system in which the final 
positions for the cathode ray tube beam would be a set of mechanical 
reference edges fixed in space in the same plane as the stored information. 
This philosophy was suggested by R. W. Ketchledge, and implemented 
by multiple channel techniques in the first complete storage systems de- 
veloped by R. E. Staehler and R. C. Davis.* A system of this type over- 
comes many of the difficulties in open-loop analog systems and makes the 
flying spot store type of svstem feasible. 


1.5 Purpose and Organization of the Paper 


This paper describes the fundamental design concepts and mode of 
operation of the flying spot store type of semipermanent memory system. 
The first section deals with physical realizability and shows that a wide 
variety of stores can be built. The succeeding sections discuss speed, 
capacity and other features and advantages resulting from parallel 
channel organization and the use of closed-loop beam-positioning sys- 
tems. The characteristics of a laboratory model of the flying spot store 
are given. 
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We have attempted to include enough detail so that the interested 
reader can proceed directly from this to other future papers which will 
describe in detail the advances in systems, circuits, devices and measure- 
ment techniques which have made the flying spot store possible. 


If, FUNDAMENTAL DESIGN CONCEPTS 


2.1 Physical Realizability 


We turn first to a discussion of the physical realizability of a single- 
channel system like that shown in Fig. 1. This discussion is pertinent 
since the flying spot store is made up of many parallel single-channel 
systems. The major advances and improvements of the flying spot store 
depend upon our ability to operate many of these channels in parallel 
from a single cathode ray tube.’ 
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Fig. 1 — Single-channel photographic storage system. 


At the start of the flying spot store project, work was begun on physi- 
cal measurements of the properties of the devices used in the single- 
channel system: cathode ray tube, phosphor, optical elements, photo- 
graphic emulsion, photocathode and electron multiplier. Very little of 
the data ordinarily available on these devices was in a form useful in 
designing the flying spot store. This measurement work has provided 
the necessary data on device characteristics for designing the laboratory 
model of the flying spot store described in Section III as well as the later 
systems now under construction. 


2.1.1 Szgnal-to-N oise Considerations in Readout 


Fluctuations in the amplitudes of 1’s and 0’s read out from the store 
result from physical imperfections in various elements of the system and 
electrical noise generated in the photomultiplier. Fluctuations in the first 
category arise from beam malpositioning, which leads to partial superpo- 
sition of information written on the plates; from halo and scattering 
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effects in the phosphor screen; from limited spot spacing on centers set 
in order to get maximum capacity per channel; and from defocusing of 
the cathode ray tube beam. There are local contributions to this noise 
due to variations in phosphor light output as a function of position, film 
blemishes, variations in film density, optical aberrations and lens vi- 
enetting. In the model of the store described in this paper, the cathode ray 
tube beam-positioning system, the spot spacing on centers, the cathode 
ray tube itself and the objective and condenser lenses have been chosen 
so that fluctuations of this type do not reduce the discrimination ratio 
in readout below 10:1. Discrimination ratio is defined as: 


Sismin _ Domex 
? 


So,max 
where S;,min 1s the minimum amplitude of a 1 signal read out from the 
store and where So,max isthe maximum amplitude of a 0 signal. Doubtless 
some improvement in this ratio can be obtained in later systems by more 
careful design. Redundancy is introduced to correct a major portion of 
the errors caused by film blemishes and the errors introduced on a per- 
channel basis by electrical fluctuations. 

Electrical noise is superposed on the fluctuations due to physical im- 
perfections. This noise arises from shot noise generated at the photo- 
cathode and from regenerative effects in the photomultiplier. Both 
components are “noise-in-signal” and affect primarily the amplitude of 
the 1 signal. The noise current from these sources is the dominant elec- 
trical noise. This is the case since the shot and regenerative components 
of the output current are much greater than the component that is due 
to thermionic emission from the photocathode in the wideband output 
circuits and at the output current level used in high-speed systems. The 
signal-to-noise ratio could be improved by increasing the light level at 
the photocathode. However, it is desirable to set the light level as low 
as possible, since this permits the widest possible choice in the selection 
of components and operating conditions for the other devices in the sys- 
tem. These considerations are made clear by the following example which 
gives the operating conditions in the information storage channels of the 
laboratory model of the flying spot store: . 

If sampling time is 0.1 microsecond, output circuit bandwidth is 3.5 
megacycles and 7,. , signal component of photocathode current is 400 X 
10-5 microamperes, then the shot noise component of photocathode cur- 
rent is given by: 


Nee 


Ushot. rms = (2eAfipe)’” = 6.7 X 10-5 microamperes. (1) 
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Under these conditions, the equivalent photocathode current required 
to account for the observed regenerative noise component of anode cur- 
rent would be 


Tregen, rms = 90.0 X 10~> microamperes, 
and the thermal emission component of photocathode current at 25°C is 
Ciichrntonie rms — 0.05 x 10-5 microamperes. 


Thus, the thermionic component is negligible compared to the shot and 
regenerative noise components. 

Upon combining the noise components quadratically, the total elec- 
trical signal-to-noise ratio is found to be 11:1. If the only noise were that 
due to shot noise the signal-to-noise ratio would be 400/6.7 = 60:1 and 
the electrical fluctuations would be small compared to those due to 
physical imperfections. 

A note about the nature of regeneration noise is appropriate here. 
Regeneration noise depends on anode current level and total tube gain. 
Recent experiments have shown that regeneration noise is associated 
with “after-pulsing” in the photomultipher. Tubes of a new design have 
been tested which do not show after-pulsing or regeneration under the 
operating conditions required in use in the flying spot store. For this 
reason, in the discussion which follows, we consider shot noise as the 
limiting factor in setting the photocathode current. 


2.1.2 Flux Levels in the System 


In the preceding section we showed how the electrical signal-to-noise 
ratio depends upon the signal component of photocathode current, Zp . 
We now determine the radiant flux required to produce this photocathode 
current, and determine the flux levels throughout the system for a typical 
case. 

2.1.2.1 Choice of Phosphor and Photocathode. The radiant flux required 
at the photocathode depends on the photocathode efficiency and on the 
match between the spectral sensitivity curve of the photocathode and the 
emission spectrum of the phosphor. All of our applications to date have 
used the type S-11 Cs-Sb photocathode. The region of high sensitivity of 
this photocathode is wide compared to the emission spectrum of most of 
the fast-decay phosphors. 

The design objective for all systems studied has been maximum speed 
in access and readout. A fast phosphor is required for this purpose and 
type P-16 has been used in all applications. It exhibits an exponential 
decay, with a time constant after aging of 0.05 to 0.06 microsecond. Its 
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spectrum is very well matched to the type 8-11 photocathode and its 
efficiency is the highest of any of the fast-decay phosphors we have 
tested. Its spectrum does not change significantly with bombarding cur- 
rent density or life. The emission spectrum of type P-16 phosphor and 
the relative spectral sensitivity curve of the 8-11 photocathode are shown 
in Fig. 2. 

2.1.2.2 Choice of Cathode Ray Tube. The preceding paragraph shows 
that the phosphor and photocathode are chosen on the basis of compati- 
bility and on the basis of speed of operation. Similar restrictions are met 
in the choice of cathode ray tube and optics. For the tube the limits are 
well defined: Here we want the brightest possible spot (i.e., greatest flux 
per unit area) of a specified size. The spot size may be fixed by system 
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Fig. 2 — Spectral emission characteristic of type P-16 phosphor and relative 
spectral sensitivity of type S-11 photocathode. 


requirements or device limitations. For example, system speed may dic- 
tate that there be one spot on the cathode ray tube face for each word to 
be stored in the memory, in order that readout can be obtained in a single 
access operation. This requirement, coupled with limitations on the 
length and diameter of the cathode ray tube which may be used, then 
fixes spot size. In other cases, the spot size may be chosen, along with 
other parameters of the system, to provide an optimum system design 
for a specific application. In the laboratory model of the flying spot store 
spot size was set by device limitations. 

The maximum current density in the focused spot depends directly 
on cathode loading and accelerating voltage.® The cathode loading must 
be limited to a value such that good tube life is obtained. In general, 
we make the accelerating voltage as high as possible, since light output 
increases with both the total current in the beam and the bombarding 
energy. However, limits are set on maximum accelerating voltage by the 
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maximum deflection voltage which we wish to provide (deflection-ampli- 
fier power consumption sets this limit) and by the allowable phosphor 
loading, (watts/em? to screen). In many cases the phosphor loading is 
the more severely limiting factor. This is easily understood because the 
power density at the phosphor screen may easily reach a kilowatt per 
square centimeter, screen weights are typically a few milligrams per 
square centimeter and the temperature rise of the screen with this power 
input is very rapid. Under such conditions, the exposure of any one 
point of the phosphor screen to the beam must be limited or the screen 
will be quickly destroyed. These factors determine the maximum total 
flux from a spot. If sufficient flux cannot be obtained for an intended 
application, either speed of operation or channel capacity must be re- 
duced. 

2.1.2.3 Choice of Optics. With the total flux determined by these fac- 
tors, the objective lens must be chosen so that the fraction of the total 
light collected which reaches the photocathode produces the required 
photocathode current level. 

Primary among the other factors that enter into the choice of optics 
is the effect of the lens on discrimination ratio. Since many parallel op- 
tical channels are combined in the store, the performance of the furthest 
off-axis lens is usually limiting. In this or any other channel the same 
beam initially writes, and later reads, the spots on the photographic 
emulsion. If the lens scatters light from the focused beam into adjacent 
areas of the emulsion, the spot spacing at the cathode ray tube must be 
made greater than that required to prevent overlap due to distribution 
in intensity in the source alone. Wider spacing reduces the number of 
spots in both coordinates of the array and reduces the total system ca- 
pacity. . 

2.1.2.4 Low Flux Level at Photocathode. The fraction of the total flux 
which must be collected by each objective lens to provide the required 
photocathode current is very small, even in the highest-speed systems. 
For example, total flux of the order of 1500 microwatts can be obtained 
from each spot in a 256 X 256 array on a type P-16 screen operated at 
the phosphor loading limit. The flux required at the photocathode to 
produce a shot-noise-limited signal-to-rms. noise ratio of 20 to 1, with 
an output circuit bandwidth of 10 megacycles, is about 0.03 microwatts. 
Thus, the lens aperture and focal length and the system magnification 
ratio must be chosen so that a fraction 0.03/1500 = 1/45,000 of the total 
flux emitted reaches the photocathode. The fraction is smaller in slower 
systems, with output circuits of narrower bandwidth. 

The important fact that this fraction is small even for high-speed 
systems cannot be overemphasized. Thus, the requirement on the frac- 
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tion of the total flux which must be intercepted by each objective lens 
can be met in a wide range of optical systems. For example, D. R. Her- 
riott has shown several designs which utilize from 36 to 300 lenses. All 
of these are scaled from the operating conditions in the laboratory model 
of the flying spot store. All keep the flux at the photocathode constant 
at the level found in the laboratory model. It is this favorable situation 
which allows us to design stores with very diverse speeds and capacities. 
Many of the other desirable features of the system result from the use 
of lenses of small aperture operated at relatively large object distances. 
For example, increasing the f/ number of a lens permits a greater depth 
of focus to be achieved. This results in much less severe axial positioning 
tolerances on optical elements, cathode ray tube and film plane. _ 

2.1.2.5 nergy Required for Exposure. One additional condition must 
be met. The flux density in the focused beam at the film plane must be 
sufficiently high to get a dense spot after development with a very short 
exposure time. This requirement arises directly from the mode of opera- 
tion, in which the entire memory plane is prepared by exposure of each 
spot in turn. It has been found that the flux level which produces a 
satisfactory signal-to-noise ratio at the photocathode, even in the high- 
est-speed system, produces, in quite ordinary photographic emulsions, 
a dense written spot with exposure times ranging from a few tens to a 
few hundred microseconds. Thus, the exposure of several million spots 
requires a few minutes at most and the process is reasonable. This is 
another of the large number of points of compatibility enjoyed by this 
particular form of system. 


2.1.3 Example of Single-Channel Design 


To illustrate the preceding discussion we present a design for a typical 
single channel suitable for use in a flying spot store. The components 
and operating conditions listed in Table I have been chosen with the 
idea of providing a large number of parallel channels. These parameters 
are intended to be a typical example rather than be descriptive of a 
working flying spot store. However, the flux levels throughout the sys- 
tem and other conditions listed in Table II have been verified in labora- 
tory experiments. 


2.2 Multtple Optical Channels 


It has been shown that one can build multiple optical channel systems 
which satisfy flux level, mechanical and optical requirements. This sec- 
tion discusses some additional aspects of multiple channel organization. 
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TABLE I — CHARACTERISTICS OF DEVICES FOR INFORMATION 
STORAGE CHANNEL 





Array size: 

Phosphor screen: 
Operating conditions: 
Spot size: 











Cathode Ray Tube 





256 X 256 
type P-16 
10 kv, 10 microamperes in focused beam 
0.025 inch 


Photomultiplier Tube 


Photocathode: 
Photocathode sensitivity 


Gain: 
Output current: 
Output circuit bandwidth: 





type 8-11 

~(0.04 microampere/microwatt (including effect 
of spectral sensitivity and phosphor emission 
spectrum) 

1.5 X 105 

350 microamperes (limited by dynode gain fatigue) 

3.5 me (0.1 microsecond sampling time) 


Optics 





Objective lens: 

Condenser lens: 

Absorption and scattering 
loss: 


6-inch, £/8.0 lens operated at 4/1 reduction 

4-inch £/3.5 

1/4.2 (losses in objective and condenser lens, 
cathode ray tube face plate and emulsion — 
extreme off-axis channel) 


TaBLE II — Power LEVELS AND OPERATING CONDITIONS IN 
SINGLE-CHANNEL SYSTEM 


Power in cathode ray tube beam: 


Peak power in focused beam: 


Phosphor screen efficiency: 
Flux from cathode ray tube: 


Fraction of light collected by objective lens: 
Fraction of light lost by scattering and absorp- 


tions: 


Flux at photomultiplier tube photocathode: 
Peak flux density in film plane: 


Exposure time: 


Photocathode sensitivity to emission from P-16 


phosphor: 
Photocathode current: 


Shot noise limited S/N; Spear/Nrms: 
Photomultiplier tube current gain: 


Output current: 


105 microwatts 

250 watts/cm? max. (limiting 
factor) 

~1.5% 

1,500 microwatts 

1/6400 

1/4.2 


0.055 microwatt 

885 microwatts/em? min. 

+100 microseconds 

0.04 microampere/micro- 
watt 

0.0023 microampere 

45/1 

1.5 X 10 

350 microamperes 


2.2.1 Information Assembly and Exposure 


In the multiple-channel store one bit of each word is stored on each 
information storage area of the photographic plate. The information to 
be stored is assembled so that all the bits to be placed on any one plate 
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appear in sequence. The addresses of the binary 1’s are then recorded on 
magnetic tape. Means are provided which allow the storage areas to be 
exposed one at a time. In writing the plates, one particular channel is 
selected and the position of the cathode ray tube beam is placed under 
the control of the information recorded on the magnetic tape. The beam 
is addressed to each spot of the array in turn. Opaque spots are generated 
by allowing the beam to dwell at a spot position for an appropriate ex- 
posure time — in the laboratory model this is approximately 600 micro- 
seconds for ordinary negative plates in which opaque spots result from 
exposure and 2000 microseconds where the plates’ photographic image is 
reversed in development. The beam is swept quickly past those areas 
which must remain transparent. When the storage areas have been ex- 
posed, the plates are removed from the store, developed and reinserted. 


2.2.2 Parallel Readout 


In general, a number of channels equal to or greater in number than 
the word length ean be supplied. With this organization, a single access 
operation (i.e., beam positioning) results in readout of the entire word 
in parallel. Because the access operation normally occupies much more 
than half of the cycle time, the time for readout of a given volume of 
information is minimized. This organization also eliminates the need 
for shift registers to assemble the parts of the word, which results in a 
minimum amount of output circuitry. It also affords advantages when 
redundancy is introduced for error detecting and correcting. 


2.2.3 Increased Total Capacity 


Multichannel stores can be built with capacities exceeding that of any 
single-channel store and without sacrificing speed of operation. 

2.2.3.1 Conditions on Maximum Number of Channels. The maximum 
number of channels depends on the maximum off-axis angle at 
which the lens chosen can be used without degrading the discrim- 
ination ratio below a specified value, upon the lens aperture and 
object distance (distance from lens to cathode ray tube screen), and upon 
the maximum flux available from the spot on the cathode ray tube screen. 
The off-axis angle and object distance determine the area of the lens 
plane which may be used. The number of lenses which may be placed 
in this area depends upon the lens aperture and, because of the restric- 
tion that the image areas must not overlap, on the magnification ratio. 
This means that the magnification ratio is usually less than one and de- 
creases as the number of channels is increased. However, the effect of 
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film blemishes might become serious at very high storage densities, and 
this may become an additional limit on magnification ratio. For a given 
limiting angle, the usable area in the lens plane increases with the re- 
duction in magnification ratio, so this additional requirement does not 
conflict with the growth in number of channels. 

If we assume that the magnification ratio is fixed by one of the preced- 
ing requirements and focal length is fixed by the over-all length of the 
system, then the solid angle in which lenses may be placed increases 
and the solid angle subtended per lens decreases, with increasing f/ 
number. The maximum number of channels is proportional to this ratio 
and grows strongly with increasing f/ number. 

2.2.3.2 Lffect on Array Srze and Resolution. All the changes which in- 
crease the number of channels do so at the expense of a reduction in reso- 
lution at the cathode ray tube. This reduction is made necessary by 
two factors. First, it is usually not possible to obtain the same resolution 
in wide off-axis positions as is obtained on axis. Second, the changes in 
the optical system which permit us to realize a large number of channels 
reduce the fraction of the light collected by each objective lens. If the 
light level at the photocathode and, as a consequence, the electrical 
signal-to-noise ratio and speed of operation are to remain constant as NV 
is increased, the flux at the cathode ray tube must be increased. Since 
the cathode ray tube is usually operated with phosphor loading as a 
limitation, this increase can only be obtained by increasing the spot size. 
Since the over-all size of the cathode ray tube remains fixed, this forces 
a reduction in the number of spots in the array. 

2.2.3.3 System: Capacity. System capacity is given by C = NR?, where 
N is the number of channels and F is the number of spot positions in one 
row of the cathode ray tube array. As we change from a single on-axis 
channel to a multiple channel system, N increases and FR decreases. 
However, R falls much less rapidly than 1/+/N, so that the total system 
capacity increases strongly with the number of channels. 

As the number of channels is increased the magnification ratio must 
eventually be reduced to avoid overlapping images. Likewise, off-axis 
operation tends to reduce the resolving capability of the lens. Finally, 
increasing the number of channels reduces the flux available to each lens, 
both because of the reduced effective aperture in the off-axis positions 
and because of the reduced solid angle subtended by each lens. These 
factors tend to require either larger spot size at the cathode ray tube to 
increase the available flux or wider spot spacing to hold the discrimina- 
tion ratio constant. Thus, increasing the number of channels tends to 
force a reduction in the number of spots used on the cathode ray tube 
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screen. However, this reduction is small enough to permit the total sys- 
tem capacity to continue to grow strongly with increasing number of 
channels. 

The system may be scaled according to number of channels, system 
capacity and speed remaining constant. If, for example, the beam diame- 
ter is doubled the flux available is increased by a factor of four, and the 
number of spot positions in the cathode ray tube array is reduced by a 
factor of four. This increase in flux permits us to use a lens of one-half 
the aperture of that in our original system, so that four times as many 
lenses can ke accommodated within the same area of the lens plane. 


2.2.4 Independence of Bits of Stored Word 


The parallel-channel arrangement is well suited to the introduction 
of redundancy for error checking and detecting. If only one bit of each 
word is placed on each storage area in the film plane, a film blemish, 
regardless of size, can affect at most one bit of the stored word. Use of 
the Hamming code® then makes it possible to detect and correct one or 
more independent errors of this type. In this case, the information to be 
stored would be encoded in Hamming single-error-correcting, double- 
error-detecting code, with the check and correction features extending 
over the Hamming bits. These bits would be read out as part of the word 
and are available at once when needed. 

There are virtually no interactions between the remote storage ele- 
ments of one storage area or between the various channels. 


2.2.5 Optical Beam Encoding 


The availability of multiple optical channels makes it possible to use 
some of these channels in the optical beam encoder, which is the sensor 
element of the closed-loop beam-positioning system. It will be shown that 
very considerable advantages accrue to the system as a whole through 
the use of this type of sensor element. 


2.3 Servo Control of Cathode Ray Tube Beam Position 


2.3.1 Description of Beam-Positioning System 


The feedback beam-positioning system is shown in block diagram form 
in Fig. 3(a). Since the positioning systems for the two deflection direc- 
tions are identical and independent, only one is shown. 

Beam positioning involves both the digital selection of a single storage 
cell and the precise positioning of the beam at the center of this cell. 
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These precise positions, as well as the binary coordinates of the cell, are 
established by the pattern on the code plates located in the same plane 
as the stored information. Each code plate occupies one channel of the 
system. Its associated lens forms a line image on the code plate of the 
spot on the cathode ray tube face. Patterns on the code plate are chosen 
so that the readout from the photomultiphers in these channels gives the 
beam coordinate in parallel binary code. This section of the system is 
termed the optical beam encoder. 

In the first step in beam positioning, the position readout from these 
code plates is compared with the required position (address) in the digital 
comparator. This comparison yields an error signal which is applied to 
the integrating and deflection amplifiers in series to drive the beam to the 
desired position. 

The simplest form of the comparator generates an error signal of the 
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Fig. 3 — (a) Feedback beam-positioning system; (b) error signal as a function 
of position. 
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form shown in Fig. 3(b). The output has a constant positive value, Vt, 
when the beam is more than one full cell above the desired address and 
an equal negative value, V~, when the beam is more than one full cell 
below the desired address. This particular type of comparator is known 
as the “sign-only”’ comparator. Comparators which yield sign and ap- 
proximate magnitude of error have also been built and are being studied. 
This discussion is confined to the sign-only type, since this illustrates 
the important system features. 

Once the beam is within the correct cell, the error signal becomes a 
continuous monotonic function of position, passing through zero pre- 
cisely at the center of the cell. This error signal is generated by the pas- 
sage of image of the beam across the transparent-to-opaque boundary in 
the one code plate column which has an edge at the required position. 
The comparator transmits the error signal without modification to the 
integrating and deflection amplifiers and the beam is locked by linear 
servo action to the code plate edge at the center of the cell. 


2.3.2 Operation of the Feedback Loop 


The action of the beam-positioning system using a sign-only compara- 
tor can be understood by considering its response to a change in address. 
The beam is assumed to be at rest at vertical level m. When a new ad- 
dress corresponding to level p is suddenly applied to the a or address 
terminals of the digital comparator, the previously existing match disap- 
pears. Since p is below m on the cathode ray tube screen, the error signal 
jumps to the full positive value V*. This step function applied to the 
integrating amplifier produces an output which increases at a constant 
rate with time. This output is applied to the deflection amplifier, which 
drives the beam downward at a constant speed towards position p. When 
the beam reaches the position p + 1, the output from the comparator 
and the speed of drive start to decrease. This is the beginning of the re- 
gion of linear servo action. 

In order to understand the action of the loop as the beam settles to 
the equilibrium position within this linear region, we must consider the 
open-loop frequency response curve of the system. This is an integrating 
type of response with high constant gain from de to a low-frequency 
break point. Above the break point the gain falls at 6 db per octave. 
The unity gain point occurs at a high frequency, typically 500 kc. To 
insure stability and a well-damped response in settling, the loop gain 
frequency response is shaped for 3 to 4 octaves beyond the frequency of 
unity loop gain. Because of the finite de and low-frequency gain, the 
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loop exhibits integrating behavior only for transient changes. After suffi- 
cient time, a step-function input results in a constant displacement by 
an amount corresponding to the de loop gain, rather than a constant 
speed. 

When the beam reaches the position p + 1 the magnitude of the signal 
from the comparator starts to decrease towards zero and the speed of 
drive diminishes. The beam actually comes to rest at the point of zero 
output voltage from the comparator only in the center of the raster. For 
all other positions the beam is off-centered by a small amount. The off- 
centering is just sufficient for the comparator output voltage, which is 
amplified by the full low-frequency gain of the integrating and deflection 
amplifiers, to maintain the beam deflection to the edge selected. Typi- 
cally, the open-loop de gain is very high and signals of 0.1V~ or 0.1V+ 
are sufficient to deflect the beam to steady-state positions at the raster 
edge. The de gain is made high so that all transfers will be completed 
within the initial 10 per cent of the ultimate response of the integrating 
amplifier to the step-function input from the logic. Within this region 
the voltage output increases linearly with time and the beam moves at 
constant speed. 

Although the full low-frequency loop gain is not needed to establish 
the readout position (readout is done before the beam settles to the 
accuracy guaranteed by the de loop gain), the gain is available to oppose 
any perturbation imposed on the system. Thus, in a system already 
operating, 60 db of feedback opposes all changes occurring with frequen- 
cies up to 300 cycles per second and 20 db of cancellation is available 
at 50 ke. Therefore, the system is much less sensitive to electrical pickup 
and mechanical vibration. This is one of the important advantages gained 
for the system by the use of a closed-loop beam-positioning system. 


2.3.3 Speed Considerations 


The speed of positioning is of major importance. In this section we 
shall show the factors which limit the maximum speed of operation in 
systems using the sign-only digital comparator mentioned previously. 
We shall also discuss the conditions which determine the time to settle 
to the readout position within the selected cell. It will be seen that these 
two factors are related. 

There is a well-defined maximum speed with which the beam may 
enter the linear region and settle without overshoot or with small over- 
shoot. If this is exceeded by a small factor, oscillatory behavior results. 
In systems using the sign-only comparator the maximum slewing speed 
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in the region more than one cell away from the match location is set by 
this requirement. 

Irom the preceding discussion, we can see that both the slewing speed 
and the time to settle from the edge of the cell depend on the loop fre- 
quency response. The maximum crossover frequency (frequency of 
unity loop gain) which can be realized depends on the asymptotic gain 
characteristic of the loop. The asymptotic characteristic is steep because 
of the relatively large number of stages in the loop. In a typical loop 
design, amplifier and logic stages contribute 6 db per octave to the 
asymptotic slope above 8 or 10 me, the effect of the finite persistence 
characteristic of the phosphor is seen as a 3-me frequency cutoff, and 
the photomultiplier tube output circuit contributes one cutoff above 800 
ke. Thus, in a typical loop, the asymptotic slope may reach 48 to 60 db 
per octave above 8 megacycles. The situation is further complicated in 
that the transit time around the loop contributes excess phase shift 
which cannot be equalized. This delay amounts to approximately 0.1 
microsecond in the systems built, and seriously reduces the phase margin 
at high frequencies. Because of the steep asymptotic characteristic and 
excess delay phase, it is helpful to introduce a flat gain step in the 
frequency response below unity gain in order to preserve stability and 
insure a well-damped settling response. 

One loop now in use has a loop crossover frequency of 500 ke. The 
maximum slewing speed is three spots per microsecond. The settling 
time to within 0.1 spot diameter of the final position is 0.8 microsecond. 


2.3.4 The Optical Beam Encoder 


The concept of the use of the optical beam encoder in the beam- 
position servo system was developed by C. W. Hoover, Jr. One version 
is shown in Fig. 4. The pattern on the code plates can be chosen so that 
the readout is in any desired binary code. Gray code (reflected binary) 
is normally used in the flying spot store. The code plate edges which 
occur at the transitions from each number to the next are used as the 
reference edges to which the beam is locked by linear servo action. 

2.3.4.1 Coupling Between Cathode Ray Tube and Film Plane. In an 
earlier section it was noted that high loop gain is available to oppose the 
effects of external perturbations. Since the code plates are located in 
the same plane as the stored information, a valuable coupling is intro- 
duced between the reading spot of light on the cathode ray tube face 
and the written information on the code plate. Thus, in the case of vibra- 
tion, the cathode ray tube might move but the reading spot of light would 


1178 THE BELL SYSTEM TECHNICAL JOURNAL, SEPTEMBER 1958 


remain fixed in space with its projected image on the written spot, as 
long as the position of the code-plate edges remains fixed with respect: to 
the written spot. Likewise, movement of the image plane as a whole 
would not cause beam malpositioning. 

2.3.4.2 Frequency Cutoffs and Time Delay in Encoder. Since the encoder 
forms part of the feedback loop, its gain and delay characteristics are 
important. Frequency cutoffs encountered in the encoder are the transit 
time cutoff of the cathode ray tube deflection plates, the cutoff due to 
the phosphor persistence characteristic and the dispersion cutoff of the 
photomultiplier and the photomultiplier tube output circuit. The 
transit time cutoff of the deflection plates and the effective dispersion 
cutoff of the multiplier occur above 100 me. Thus, they contribute vir- 
tually no phase at or near the frequency of unity loop gain and can be 
excluded from the asymptotic characteristic in this region. The effect 
of the phosphor persistence can be represented by a 3-mc frequency 
cutoff. The other important cutoff is found in the photomultiplier tube 
output circuit. The output resistor is chosen to give a voltage swing of 
about 3 volts to operate the digital comparator with fatigue-limited 
maximum output current of the photomultiplier. Typically, this resistor, 
with the output and circuit capacitances, results in a frequency cutoff 





CATHODE RAY 
TUBE ‘ 


\ 
CYLINDER \ 
LENS \ 





~~ 


Ce 
( 
| 
( 
i 


\- 
\ 

} 

{ 

} 

1 
L-— 7 


Fig. 4 — Two-axis optical beam encoder. 


DESIGN OF THE FLYING SPOT STORE 1179 


of about 800 ke. Thus, the optical beam encoder contributes only two 
important cutoffs to the asymptotic loop characteristic. 

Most of the signal delay found in the loop is due to the encoder. Here 
are found the transit time delays because of the electron transit time 
from the deflection plates to the cathode ray tube screen (approximately 
7 millimicroseconds), the time of flight of light in the optical path 
(approximately 4 millimicroseconds) and the electron transit time in 
the photomultiplier (50 millimicroseconds). As mentioned earlier, these 
delays play a part equally important to that of the open loop gain char- 
acteristic in determining the speed of slewing and settling. 

2.3.4.3 Lincoding Transconductance. One measure of the utility of an 
encoder is the encoding transconductance. For the optical beam encoder, 
considered as a unit from the cathode ray tube deflection plate terminals 
to the photomultiplier tube output, the encoding transconductance is 
defined as . 


J _ dt 
ee AY : 
1—0 (2) . 
0-1 


where Az is the current change at the output of the photomultiplier as 
the beam moves from an opaque area on the code plate to a clear area 
and AV is the voltage change at the deflection plates required to move 
the beam from the center of one spot position to the center of the ad- 
jacent spot position (i.e., to change a “1” to a “0” or vice versa on the 
least significant digit code plate). The maximum change in current, Az, 
is limited by the maximum current which can be drawn from the photo- 
multiplier tube without serious fatigue. J. R. Pierce (Ref. 5, p. 142) has 
shown that there is a theoretical limit on the minimum possible deflec- 
tion sensibility [defined as volts to move the beam by an amount equal 
to the spot diameter — note that this is precisely AV in (2) above]. This 
dependence is given in 


. 1/2 
AVE K (‘u=) Vas (3) 
Jo 
where jmax is the maximum current density in the beam, jo is the cathode 
current density, V. is the potential in the deflection region and K is a 
constant depending on the geometry of deflection plates and focusing 
system. In the cathode ray tube designs for the flying spot store, the 
ratio of current density in the spot to the cathode current density is 
very nearly constant. This is because current efficiency is sacrificed for 
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intensity efficiency (jmax/Jo) in these tubes. At low current efficiency, 
the ratio (jmax/Jo) is nearly constant (Ref. 5, p. 125). Thus, we see that 
minimum deflection sensibility increases directly with the accelerating 
voltage. Therefore, to obtain maximum encoding transconductance in 
the encoder it is desirable to choose the minimum value of accelerating 
voltage at which the desired light output and resolution can be obtained. 
The transconductance does not increase with increasing accelerating 
voltage simply because the fatigue limit on photomultiplier output cur- 
rent prevents us from taking advantage of higher output currents due 
to greater light inputs to the multiplier. 

A typical encoder has a deflection sensibility of 2 volts per spot and 
an output current of 2 ma. This yields an encoding transconductance of 
1000 micromhos and should be compared with the encoding transcon- 
ductances of 100 micromhos typically obtained in electron beam encod- 
ing tubes. 

2.3.4.4 Effect of Encoder on Cathode Ray Tube Requirements. Finally, 
we note the effects of the use of the optical beam encoder on the cathode 
ray tube. Since the complete array of positions is specified by the fixed 
code-plate masks, it should be possible to change cathode ray tubes, 
after a failure, without rewriting the information on the storage plates. 
In addition, the requirements on cathode ray tube deflection direction 
orthogonality and uniformity of deflection sensibility with position are 
virtually eliminated. Consider, for example, the effect of a 10 per cent 
change in deflection sensibility. In analog beam-positioning systems this 
would result in local crowding or expansion of the pattern. In the closed- 
loop system this merely results in a very small change in the time re- 
quired for the beam to settle to its final position. 


2.3.5 The Digital Comparator 


Several types of comparator have been developed by R. W. Ketch- 
ledge. However, since our purpose is to show general principles and mode 
of operation we confine our discussion to the sign-only form of the com- 
parator. This form has been termed the sign-only servo. 

As a first step in the description of the comparator we note all of the 
special conditions placed upon it by the application. These are as follows: 

1. Parallel operation. Speed dictates that the comparator operate on 
parallel inputs from the input register and optical beam encoder. 

2. Carry from most significant to least significant digit. When the 
position is changing rapidly the values of the encoder digits of low signifi- 
cance become indeterminate. Use of a carry in the normal direction 
would therefore seriously limit speed. 


DESIGN OF THE FLYING SPOT STORE 1181 


3. Linear transmission characteristic within selected cell. or signals 
of magnitude less than V+ or V~ the comparator merely transmits the 
error signal generated by one edge in the optical beam encoder. 

4. Gray-binary comparison. The input addresses to the flying spot 
store are in parallel binary form. The code plates of the optical beam 
encoder read out the beam position in the Gray or reflected binary code. 
This code has the very desirable feature that one and only one digit 
changes in going from any one level to either adjacent one. 

5. Compatibility with servo loop. The transmission and delay charac- 
teristics of the digital comparator must be such that it can be included 
in the servo loop without serious penalty in speed and stability. Its 
frequency response should be flat to well above the frequency of unity 
loop gain and it should contribute as few cutoffs as possible to the 
asymptotic characteristic. The delay should be such that the equivalent 
phase at gain crossover is tolerable. 

Sign-only logic meeting these requirements has been built. We now 
turn to a discussion of the actual mechanism of number comparison. 

The starting point is the following set of rules for obtaining the sign 
of the error between two parallel binary numbers. These are developed 
first for the case of binary-binary comparison and extended later for 
the case of binary-Gray comparison. 

Consider two binary numbers, A and B, with A being the address 
number which remains fixed throughout the cycle of comparison and B 
being the position number which takes on all successive digital values 
in approaching A. Thus we have two numbers: 


Address, A: Gm, Qm—1,Qm—2,*** Qj,*** Qo, 
Position, B: 0m, bm—1, Om—2, °+* 03, +++ bo, 


where a» and b,, are the most significant digits, and where the first mis- 
match is found at the jth digit. The first mismatch determines the sign 
of the error. The rules are as follows: 

1. Consider the pairs of digits a; , b;. 

2. Write a third number c; resulting from each comparison. 
- 3. Starting at the most significant digit, write c; = 1 for all matches 
up to the first mismatch. 

4, At the first mismatch, a; , b; , choose c; as follows: 


i a; > be es0;7:= 1, b; = 0), 
c; = 0, a; < b; (e., a; = 0, b; = 1). 


5. Following c; , write c; = 1 for all remaining digits, if a; = bj. 
6. Combine the m digits, ¢n --- ¢o, resulting from these operations 
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in an m-input coincidence circuit. The output of this coincidence circuit 
will be 1, 1.e., a coincidence resulting from an input on each of the m 
leads whenever B S A. As B changes from equal to A to greater than A 
the coincidence disappears, and for all cases B > A the output of the 
coincidence circuit is 0. Examples will make this clear. The m, c; outputs 
go to individual leads of an m-terminal coincidence circuit. 


Example 1: B< A 
(= 


1 1101 0 


010411 0 


i 
1 
| 
rt 
! 
1 
| 
| 





| 

| 
b: 1 1010 10 
a ee ale ae a a 


ea ees a a) as Ca 
__t 
In this case the c; values are all |. Therefore the coincidence circuit 


output is also 1. This output drives the beam in the direction required 
to reduce the value of B. This is defined as a down drive. 


Example 2: B= A 
Opeo de WO Oe dada oh. Gy ie. 


bes. 2, Oe 1. Oe Tee a 20 9 


Cre ob al a OE edd ee ae al 
Here again the coincidence circuit output is 1 and the direction of 
drive is down. 


Example 3: B> A 
t=] 


0 


0 


! 

101 

are 

ve 
be Ue dO a a AAs a Od 020 
Se 
Gee Ae A 


In this case comparison of the c; inputs in the coincidence circuit 
results in 0 and the drive direction is up. 
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T’rom these examples we see that the beam continues to move after 
the point of numerical equality is reached. The rest position is one-half 
cell distant from the point of numerical equality in the direction in 
which B increases. Thus it is seen that the storage cell boundaries are 
displaced by one-half cell from the code plate edges. When the Gray 
code is introduced, it will be seen that the significant advantage of this 
code is that, at any level, all digits except the one changing remain at 
full-amplitude readout as the beam is moved beyond match by one-half 
cell position. 

Now we shall develop a generating function for the m inputs, cn, 
Cm-1, °** Co, to the final coincidence circuit. Once we have this generat- 
ing function in logical notation we can at once set down the block dia- 
gram of the logic circuit. We start by observing that, under our rules, 
the value of any c, say c, , is determined either by the kth digit pair or 
by a mismatch in a more significant digit pair. We note that the func- 
tion a, + b,’ = 1 for a, = b, , but that a, + b,’ = Ofora, < h. 

We can use this function to provide the correct output if the first 
mismatch occurs at the kth digit. However, our rules say that the most 
significant mismatch rules. Hence a mismatch occurring at the kth digit 
of the form a, < b, ; a, + b,’ = 0 must be overpowered by a more 
significant mismatch of the type an > bm, so that the resultant c, is 
a1. To take care of this possibility, we consider all more significant pairs. 
The function a,b,’ has the characteristic that it is 1 only for a mismatch 
condition in which a > b. Hence, if we combine all digit pairs for digits 
more significant than k with a parallel OR circuit, c, will always be 1 
when it is preceded by a mismatch of the type a; > 6; . Finally, we note 
that a; + b; = 0 at the first mismatch, for a; < b;, and that a,b,’ = 0 
for all k > 3. Thus the correct down drive is attained. Our generating 
function is therefore 


Cr = (a, aa b,") i AnD’ Omn—Wm—V + eee Op Dest’. 


The logical circuit realization is shown in Fig. 5. Note that the carry is 
formed by the long string of OR functions proceeding from the most 
significant digit towards the least significant digit. For reasons noted — 
earlier, it is necessary to get a version of the comparator in which the 
position inputs, b,, --- bo , in binary code are replaced by position inputs 
in Gray code, gm ++: go. We first note that any translation operation 
must translate the Gray-code inputs to the equivalent binary-code in- 
puts, starting with the most significant digit and working down to the 
first mismatch. However, the translation must not destroy the property 
that only one digit changes at a time. If the translation has the proper 
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Fig. 5 — Sign-only comparator, binary-binary type. 


behavior for match conditions and for the first mismatch, this function 
may be added to the circuit of Fig. 5, since all c, for digits beyond the 
first mismatch are disposed of by the carry which proceeds within the 
circuit already developed. 

To start with, we note that the Gray-code number equivalent to any 
binary-code number can be generated by applying the following rule in 
sequence to the digits of the binary number: 


ge = by © deqi. 


The symbol © denotes the “ring sum” or “exclusive or’’. Its properties 
are shown by the following table: 

bi. Bray be @® Bea 
1 0 


COOH 


0 1 
1 1 
0 0 
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Now consider the nth digit which is preceded by a match condition. In 
this case we may write 


bn = b, ce) Dnt1 ® On+1 


since Das: © Anyi = O, all digits with 7 > n are matched. In this 
regrouping we have the term b, © b,41, which is simply g, . Therefore 
we may write 

bn = gn ® On+1 . 


The number formed using this rule provides the correct translation down 
to and including the first mismatch. This translation also retains the 
Gray-code property of only one digit change at a time. 

As we have noted, this is sufficient. R. W. Ketchledge, who dis- 
covered this translation property of the function g, © an41, has termed 
the number formed using this rule a pseudo-binary number. It is the 
simplest form of translation which allows us to translate a Gray-code 
number to a form suitable for use in operating the comparator. Its util- 
ity can be easily understood if we compare this form to the usual rule 
for translating from Gray to binary, which involves counting down 
modulo 2 from the most significant digit to the digit to be translated, a 
process which clearly involves all of the more significant digits. 

Transforming the preceding expression we have | 


Dn’ = (Gn © Gng1)’ = Gn ® Anti © 1 = Ya © Any’. 
This gives us a form eminently suitable for direct replacement in our 
function c,. Note that the new c, has the proper behavior at the first 
mismatch. Substituting, we then get our new form for c; : 
Ce = lan + (ge ® Gerr’)] + Gnlgm ® Any’) +++ + AeyiGey1 @O duis) 


Here we note that the term a,,/ is 1, since all digits in positions of 
+ 5] 

greater significance than the most significant digit are necessarily zero. 

There we may write: 


An(Gm ® Amt) = AmJm - 


Substituting this into the expression for c, above results in a form for 
c. similar to that for the binary-binary comparator. The logic circuit 
can be drawn at once from the expression and is shown in Fig. 6. 


Ill. LABORATORY MODEL OF THE FLYING SPOT STORE 


3.1 Application 


The flying spot store discussed in this section was developed to meet, 
the requirements of the electronic telephone switching system described 
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elsewhere in this issue.! The objective was to provide the speed and 
capacity needed for a realistic test of the laboratory model of the switch- 
ing system at as early a date as possible, rather than to obtain maximum 
capacity. As a consequence, many of the desirable features and refine- 
ments which can be incorporated in later stores are not included in this 
model. Nonetheless, it does provide all essential features required for 
the test. 


3.2 Requirements 


3.2.1 Capacity 


Because the laboratory model of the switching system serves only a 
few lines and because feasibility can be demonstrated by setting up a 
call without providing all of the ancillary routines of a full-sized switch- 
ing system, the capacity required of the laboratory model of the flying 
spot store is small, 35,721 bits. Word lengths of 18 and 36 bits are uti- - 


am aS 
gmt) 


aim 
Om-t 
OUTPUT 
De 
alm-t 
gm-2 
ay 
go- 





Fig. 6 — Sign-only comparator, binary-Gray type. 
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lized for this application and the output word is assembled from two or 
four readouts from the store. The x and y addresses are each six binary 
bits. The array size is 64 X 64. 


3.2.2 Mode of Operation 


The laboratory model of the flying spot store has been in operation 
in the experimental electronic switching system for some time. In this 
application the store operates in response to input addresses and control 
signals (orders) supplied by the central control. A block diagram of the 
store showing input, output and control leads is given in Fig. 7. The 
output word is assembled in the output shift register from two readouts 
of nine bits each from the nine parallel storage channels. The central 
control of the system then takes this word from the output register. 

Two main orders are used. These are “advance” and ‘transfer’. In 
an advance order the word to be read out is located adjacent to the last 
word read out. This is the order most frequently used in the system. In 
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Fig. 7 — Block diagram of flying spot store. 
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this mode of operation a single signal is supplied from the central control 
to the advance lead. This signal brings about the following events in 
the internal program section of the store: The existing address in the 
X-axis input register is incremented by one. In response to this, the 
beam is driven to the adjacent location. Once it is there, a sampling sig- 
nal is generated and applied to the sampling amplifier in each informa- 
tion storage channel. The resulting samples set the flip-flops in the output 
register. Following this, the internal program shifts the information to 
the second section of the shift register, again increments the input 
address register and, after a delay for beam positioning, generates an- 
other sampling pulse. The second sampling operation provides the second 
half of the word. 

The transfer order differs in that the word to be read out is located 
remote from the preceding word read out. In this case the central control 
furnishes a signal on the transfer lead as well as a complete new address 
and a greater time is provided before sampling to permit the beam to 
reach the remote location. Cycle time in this case consists of beam transit 
time plus the normal sampling cycle time. At the completion of both 
transfer and advance orders a “cycle complete” signal is generated by 
the internal program, and sent to central control. In the few instances 
where the word length is 36 bits, the word is assembled in the central 
control after two successive readout operations from the store. 

In addition to these functions the internal program of the flying spot 
store also provides special control signals used during plate preparation, 
line-up and trouble shooting. 


3.2.3 Speed of Operation 


In the laboratory model of the electronic switching system the flying 
spot store operates at a cycle time of 12 microseconds in the advance 
mode. This includes the time for incrementing the address register twice, 
two beam positioning operations and two half-word readouts, plus the 
assembly of the word in the output register. The maximum time to com- 
plete a transfer order is 25 microseconds. 

Operating by itself, this flying spot store has performed satisfactorily 
at a cycle time of 3 microseconds for the advance order and 25 micro- 
seconds for the transfer order. In this case, the one-spot beam position 
change required has been completed in 0.8 microsecond. 


3.3 Components 


Fig. 8 is a rear view of the flying spot store, showing the placement 
of the various devices. 


DESIGN OF THE FLYING SPOT STORE 1189 








Fig. 8 — View of flying spot store with gates open. 


3.3.1 Cathode Ray Tube 


The cathode ray tube is shown at the top of the cabinet. It is supported 
above the main casting which holds the lenses, information storage and 
servo code plates, and is surrounded by a magnetic shield. The tube is 
7 inches in diameter and is electrostatically focused and deflected. It is 
operated at a total accelerating voltage of 10 kv, with a beam current 
of 10 microamperes to the phosphor screen. The working area on the 
tube face is 3 X 3 inches. The phosphor used is type P-16. The screen is 
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aluminized and has a weight of approximately 6 mg per square centi- 
meter. 


3.3.2 Optical System 


The system uses nine Petzval lenses arranged in radial on-axis posi- 
tions. Four of these can be seen protruding from the body of the support 
casting in Tig. 8. The storage plates are located within special mounts 
which are bolted to the main casting. A section of rubber tubing between 
the end of the lens and the storage-plate mount keeps the system light- 
tight and dust-free. 

The lenses were originally intended for use in a much higher resolution 
system in which the available flux from each spot on the phosphor screen 
would have been lower by a factor of 16 or more. In the present applica- 
tion they have been stopped down to f/13. This provides greater depth 
of field and ease of adjustment, as well as reasonable exposure times for 
the emulsion chosen. The focal length of the lenses is 10 inches, and they 
are operated at a magnification ratio of 1:2. Thus, the storage area on 
each plate is 1.5 X 1.5 inches. 

The storage plates are positioned in their mounts in the image plane 
of the system by three steel pins which bear against two ground edges 
of the glass photographic slides. A special magazine has been developed 
which allows a plate to be loaded into the channel for exposure, re- 
moved after exposure for development and reinserted after develop- 
ment. 

A condenser lens is located beneath the image plane in each channel. 
This lens images the stop in the objective lens into a circle one-half inch 
in diameter on the face of the photomultiplier. This lens is required by 
the point-to-point nonuniformity of the photocathode response, which 
would introduce additional signal fluctuations into the channel if the 
narrow beam from the objective lens were to fall directly onto the photo- 
cathode. 


3.3.3 Photomultiplier Detector 


A photomultiplier tube is located in each storage channel. The tube 
used is a 10-stage type, operated with an output current of 350 micro- 
amperes in the information storage channels. The total gain required is 
~ about 200,000. At the input light level obtained in each channel of this 
system, the signal-to-shot-noise ratio is high. The discrimination ratio 
under these conditions is of the order of 10:1, where the fluctuations in 
the amplitude of the pulses read out from each channel are principally 
due to phosphor and film nonuniformity and to some regeneration noise 
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in the photomultiplier tube. Satisfactory operation has been obtained 
with this signal-to-noise ratio. 


3.3.4 Sampling Amplifier and Output Register 


The output from each information channel photomultiplier detector 
is connected to a sampling amplifier. This section consists of an equaliza- 
tion and gain stage followed by a sampling stage and output amplifier. 
Gain is used following the photomultiplier tube output to make the 
detection of a 1 readout less dependent on power supply voltages. 

The sampler outputs are fed to a shift register which is used to assem- 
ble the two or four readouts from the store into the word required by 
the system. The sampling amplifiers are arranged in a ring beneath the 
information channels. The output register packages are contained in a 
gate shown in Fig. 8 open at the upper right-hand side of the enclosure. 


3.3.5 Optical Beam Encoder 


The store uses an optical beam encoder of the type shown in Fig. 4. 
Two cylinder lenses are used, which are not visible in Fig. 8 since they 
are enclosed within the central part of the casting. They are arranged to 
provide two orthogonal line images, which fall on a pair of code plates 
with patterns arranged to give a Gray-code readout of position. A light 
pipe is provided beneath each column of each code plate to conduct a 
fraction of the light passing through that column to an individual photo- 
multiplier detector. The light pipes are required because of space limita- 
tions on the code plates and the cylinder lens system. 

In this type of encoder the length of the line image is made twice the 
width of the code plate to allow movement of the spot over the entire 
storage area without loss of position readout in any digit. Consequently, 
each digit column receives less than ;; of the total light collected by 
each cylinder lens in the seven-digit encoder provided in this store (only 
six digits are presently in use). In addition, there are losses in the light 
pipes. For these reasons, the fraction of the light which must be collected 
by each cylinder lens is much larger than that which must be collected 
by each information channel lens. The cylinder lenses used in this system 
operate at f/2.8, with a focal length of 10.0 inches. They are used at a 
magnification ratio of 1:2. 


3.3.6 Beam Position Servo System 


The readouts from the optical beam encoder photomultipliers are 
transmitted directly to equalizing amplifiers located directly beneath 
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them and connected to the digital comparator. The comparator used is 
the sign-only type discussed earlier. The x- and y-axis comparators are 
located at the bottom of the enclosure on gates (one is shown at the 
bottom right in Fig. 8). The error signal resulting from the comparison 
and code-plate readout drives the integrating and deflection amplifiers 
which are mounted at the top of the enclosure near the cathode ray tube. 


IV. SUMMARY AND CONCLUSIONS 


4.1 System Capacity and Number of Channels 


It has been shown that flux and signal-to-noise conditions must be 
met in flying spot stores with very high capacity and large number of - 
channels. One important limitation is the maximum flux per unit area 
which can be obtained from the phosphor screen on the cathode ray 
tube. With specified maximum tube diameter and flux from the spot, 
the minimum spot diameter and maximum number of spots in the array 
on the tube face are fixed. As long as this limitation on the maximum 
number of spots in the array is not exceeded, maximum system capacity 
at a constant speed of sampling is not critically dependent upon the 
number of channels. Therefore, in most applications the number of chan- 
nels may be chosen to provide word readout, together with error detec- 
tion and correction bits, in a single-access operation. 

System capacity increases with increase in sampling time but, due 
to resolution limitations on the optical elements and the cathode ray 
tube, this increase can usually be obtained only by increasing the num- 
ber of channels. 

The flying spot store type of memory is essentially a large-capacity 
device, since most of the elements must always be supplied and very 
little equipment is chargeable on a per-channel basis. This nearly fixed 
bulk of equipment in high-capacity stores means that the number of 
bits stored per active element in the control and sampling systems can 
be very large. This is one of the important advantages of this type of 
memory. 


4.2 Compatibility of Devices 


A very wide range of compatibility exists among the devices used 
in the store. Thus it has been shown that the emission spectrum of the 
most efficient fast-decay phosphor available is well matched to the 
spectral sensitivity curve of the efficient type S-11 photocathode. The 
efficiency and burn characteristics of this phosphor are such that the 


DESIGN OF THE FLYING SPOT STORE 11938 


light level required at the photocathode in very high-speed systems can 
be obtained, even with lenses of high f/ number operated at magnifica- 
tion ratios considerably less than unity. The last two conditions permit 
very wide latitude in the choice of number of channels and result in 
reasonable tolerances on axial positioning of cathode ray tube, lens and 
storage plane. Finally, it has been found that the flux level at the photo- 
cathode which provides the required signal-to-noise level in readout is 
sufficient to create a dense image in the film after development, with 
short exposure times. This permits writing and reading with the same 
beam. 


4.3 Multiple Channel Organization 


The multiple channel organization permits large-capacity stores to be 
built without causing any of the devices to operate at the limit of resolu- 
tion. This reduces the problems in the procurement of devices and tends 
to increase reliability i the system as a whole. It also provides for maxi- 
mum possible speed of operation, since the total word is obtained in a 
single access operation. Some of the multiple channels are used in the 
optical beam encoder which is the sensor element of the servo. This type 
of sensor has been shown to be well suited for use in the servo loop. In 
addition, it introduces a valuable coupling between cathode ray tube 
and film plane which renders the system less sensitive to mechanical 
vibration and electrical pickup. Finally, the true independence of stored 
bits arranged so that only one bit of each word appears in each channel 
makes the flying spot store ideal for the use of error detection and cor- 
rection codes. 


4.4 Closed-Loop Beam Positioning Systems 


Closed-loop beam positioning systems have been developed to over- 
come the analog accuracy problems encountered in open-loop systems. 
These systems provide digital beam positioning to within one spot diam- 
eter of the position for readout, followed by linear servo action in which 
‘the beam is locked to one of the code-plate edges of the optical beam 
encoder. A special digital comparator generates the error signal when 
the beam is more than one spot diameter distant from the required posi- 
tion for readout; it passes the proportional error signal without modifi- 
cation when the beam is within one spot diameter of the readout loca- 
tion. This comparator meets the special requirements imposed by its 
being included in the servo loop plus the requirements of the digital 
number comparison. 
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Complete systems based on this comparator plus the optical beam 
encoder are in operation in the laboratory and in the laboratory model 
of the flying spot store. They provide reproducible beam positioning with 
an accuracy of +0.1 spot diameter. Typically, the time to position the 
beam to this accuracy from a one-spot distance is 0.8 microsecond, and 
the maximum slewing rate in the region more than one spot distant 
has been found to be about three spots per microsecond. 
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A High-Speed Barrier Grid Store 


By T. 5. GREENWOOD and R. E. STAEHLER 
(Manuscript received November 22, 1957) 


This paper describes a high-speed random access memory developed to 
serve an experimental electronic telephone switching system. The memory 
uses a barrier grid type electrostatic storage tube which is incorporated in a 
complete general-purpose store with a capacity of 16,384 bits. Random 
access to any bit together with a full storage cycle of reading and writing is 
complete in 2.5 microseconds, permitting a 400-ke repetition rate. 

Haperience with this store indicates that barrier grid storage can provide 
stable, compact, economical memory for data handling systems. 


I. INTRODUCTION 


The last two decades have seen a phenomenal growth in the field of 
digital data handling systems of large capacity. Prior to 1940 the 
telephone central office contained the only large-scale systems to be 
found. Since that time the number of special and general-purpose 
computers has mushroomed and, at the same time, the demands on 
special data handling devices for such systems have become more 
severe. One of the more thorny problems has been that of providing 
adequate storage for the large amounts of information received and 
generated by the systems. Early systems effectively used electro- 
mechanical relays for information storage, but the demands for speed 
and economy have forced the system designer to go far afield in his 
search for satisfactory memory devices. 

While many devices have been developed for memory purposes, each 
particular system has requirements which limit the choice to relatively 
few of them. Those systems having most severe choice limitations re- 
quired a random access memory with very high-speed reading and 
writing. Prior to 1950 the choice was limited to some form of electro- 
static storage tube. With the introduction of magnetic core storage the 
field was widened. Because of the discrete nature of its storage unit and 
the convenience for individual experimentation, the core became the 
focus of considerably more attention in recent years. In contrast, the 
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bulk nature of storage in tubes and the complex technology of such 
tubes required more extensive group efforts. 

While widespread use of storage tubes has declined, the development 
of storage tubes and related techniques has continued and these tubes 
have retained a competitive position with cores. Storage tubes appear 
to have some advantage in speed and economy, while cores have a 
slight advantage in size and power consumption. Because these dif- 
ferences are small, the specialized requirements of a contemplated 
system may exert a profound influence on the choice of memory medium. 

The form of electrostatic storage tube now most widely used is the 
barrier grid tube. Such tubes have been described by Jensen,! and 
Hines, Chruney and McCarthy.” They are fast, reliable and economical. 
This paper describes an unusually high-speed memory utilizing such a 
tube and is indicative of the barrier grid tube’s present speed and capa- 
city. 


II. SYSTEM REQUIREMENTS 


This store was developed to provide the erasable memory of the 
experimental electronic telephone switching system described in detail 
in a companion paper.’ To serve this system, the memory was required 
to perform a complete memory operation (a random access plus a 
reading and writing operation) in 2.5 microseconds. Because of the 
nature of the system, large numbers of single-bit words were used and a 
serial memory was adequate for longer words. For this reason, the 
memory was designed to read or write a single bit at a time. 

The limited nature of the system experiment and the use of large 
amounts of nonerasable memory reduced the erasable storage require- 
ment to a few thousand bits. However, since a working telephone system 
would require considerably more memory with no essential change in 
other requirements, the store was designed to have as large » capacity 
as possible consistent with other requirements. 

Because an inherent feature of barrier grid storage is the need for 
periodic regeneration of information, the store imposed some restriction 
on the system. A requirement of the barrier grid tubes used was that 
every bit in the memory be regenerated at least once each second. 
Because of interaction between adjacent storage locations, a somewhat 
higher rate of regeneration was required in most areas of the memory. 
This rate depends upon the performance level of the storage tube and 
the specific pattern of memory consultation. For the particular system 
using the barrier grid tubes available, a study indicated that no more 
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than 10 per cent of the working time of the system was needed for this 
regeneration. Since the system is a real-time data processer in which 
the full system time is used only during infrequent periods of maximum 
input data rate, the effect of regeneration time is very small. 

Since the switching system did not provide common power supplies 
for its various units, the store was designed as a self-contained unit 
including power. Thus, the resulting store was a general-purpose memory 
which could be applicable to other data processing systems of a similar 


type. 


III. DESIGN OBJECTIVES 


The storage capacity of a barrier grid tube depends upon the combined 
analog resolving power of the tube and the deflection circuitry. With 
high-speed random access, the settling time of the deflection system 
usually sets the limit on resolving power. Since the desired memory 
required the deflecting of only one barrier grid tube, it was decided to 
devote sufficient effort to the deflection system design to achieve nearly 
the ultimate resolution of the tube. At the performance level needed, 
the capacity of the tubes was around 16,000 bits; accordingly, the 
capacity objective was a square array of 16,384 (128 X 128) bits. 

Within the 2.5-microsecond cycle time imposed by the system, three 
separate store operations were required: beam deflection, reading and 
writing. The reading and writing durations were set by the tube design 
and at the capacity: desired were 0.8 microsecond. With a 10 per cent 
design margin, the time remaining for deflection was 0.7 microsecond. 
Because of other requirements, it was necessary to deflect in somewhat 
less time and the design objective was from 0.4 to 0.5 microsecond. It is 
clear that any significant decrease in cycle time for the system requires 
faster barrier grid tubes; a 2.5-microsecond cycle is near the present 
practical upper limit. 

To avoid excessive deviations in the duration of store operations, 
precise timing pulses were required within the store. The objective for 
these pulses was a single cycle of a squared 5-mc sine wave, which 
would give a pulse rise time of 0.05 microsecond. Since the inputs from 
the system were expected to be slower, input buffer circuits were pro- 
vided. The pulse amplitude was set at a nominal 15 volts, with satis- 
factory operation at a 10-volt minimum. 

At any designated location it was desired to have four alternative 
modes of operation. Each operation required the store to read and 
subsequently either (i) writea zero (WRITE 0); (ii) write a one (WRITE 
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1); Gi) write the same binary state as was read (REGENERATE); or 
(iv) write the binary state opposite to that read (REVERSE). Opera- 
tions (i) and (ii) are the minimum necessary to provide storage. Be- 
cause of the frequent occurrence of operations (ili) and (iv), it was 
observed that much system time could be saved by including the 
necessary logic for these operations within the store. . 

The functional block diagram of the store is shown in Fig. 1. The 
memory section contains the barrier grid tube and its associated de 
control circuits. The deflection system contains all circuits necessary to 
direct the beam to the selected location and assure its proper focus. 
The control section contains the circuits which issue the proper sequence 
of pulses to execute the desired storage operation. The readout section 
provides gain and quantization of the readout pulses. 

The implementation of the store operations requires pulses from the 
system on a selected set of 15 leads. The pulses on 14 of these leads 
define the binary state of a 14-digit binary number specifying the 
location of the bit. The remaining pulse, on one of four leads, specifies 
the storage operation to be carried out at the selected location. In 
normal operation, all 15 pulses arrive at the store simultaneously. 
However, proper operation of the store is achieved as long as no address 
pulses arrive in the 2.5-microsecond period following an operation 
order pulse. Each address digit is retained in the store until changed, so 
that the operation order will be carried out at the location specified by 
the complete set of most recent address pulses. Approximately 1.5 
microseconds after the operation order, a readout 1 or 0 lead is pulsed 
by the store. 
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Fig. 1 — Barrier grid store system block diagram. 
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Fig. 2 — Barrier grid tube. 


IV. SECTIONS OF THE BARRIER GRID STORE 


4.1 The Memory 


The storage tube used in the memory is similar to that described in 
detail in Ref. 2. It uses electrostatic deflection and focusing and operates 
at an acceleration potential of 1000 volts, but it differs from that tube 
in having a double focusing lens. The two control apertures of the lens 
have elliptical instead of circular shapes and are placed with their 
major axes at right angles. The lens is aligned with the deflection plates 
so that each aperture corrects, more or less independently, for the 
defocusing caused by a particular set of deflection plates. This type of 
structure facilitates the application of dynamic correction for deflection 
defocusing. A photograph of the tube is shown in Fig. 2. 

The target structure of the tube consists of a mica sheet approximately 
0.001 inch thick placed between a 500-mesh barrier grid on the gun 
side and a conductive back plate on the opposite side. The space 
between deflection plates and target is occupied by a conical electron 
collector assembly. 

When the beam is directed at a point on the mica, the area under the 
beam charges to an equilibrium potential approximately equal to the 
fixed barrier grid potential. The potential thus obtained represents the 
storage of a binary 0. Writing a binary 1 is a similar process, except that 
a positive potential is applied to the back plate during the mica charging 
process. When the back plate potential is restored to zero after the charg- 
ing, the capacitive coupling to the mica causes it to finally assume a 
potential more negative than the barrier grid, representing a 1. 

Reading is accomplished by the same operation as writing 0. During 
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this process, the current flow away from the mica will depend upon 
whether the spot is already at equilibrium. Thus, there will be a different 
current flow for a 1 or a 0. This flow may be observed either at the 
collector or at the target (barrier grid plus back plate). The first method 
is called collector reading, and is used in this store. The second method 
is called target reading, and offers distinct advantages in signal uni- 
formity and detection. Unfortunately, the current required to charge 
the back plate to barrier grid capacity for the write 1 process also 
flows in the target leads. This current is about one-half ampere, while 
the signal current is about one microampere. To maintain the desired 
cycle time of the store it is necessary for the readout amplifier to com- 
pletely recover from the large writing pulse on the previous spot in 
about one-half microsecond. Ref. 2 describes a method of driving the 
back plate through a transformer wound with coaxial wire, which would 
reduce the interference from 500,000 to about 20 times the readout. 
Although this method holds considerable promise for the future, the 
residual recovery time problem was still a deterrent to its use in the 
present store. 

With collector reading, both the 1 and 0 signal are of the same polarity 
and the 1 is 30 to 50 per cent larger than the 0. To decide whether a given 
readout is a 1 or a O requires an amplitude discriminator. With a fixed 
discrimination level, variation in the 0 amplitude over the surface 
represents a noise component. This is discussed by Hines under the 
subject ‘shading’. In the tubes used, the construction was carefully 
controlled to minimize shading. 

A figure of merit used for these storage tubes is the read-around- 
number (RAN). This refers to the number of complete storage operations* 
that can be carried out at a storage location without causing erroneous 
readout from an adjacent location. For any particular tube, the RAN 
figure of merit is the smallest such number obtained by testing all 
locations and all combinations of interfering and adjacent spots. Such a 
figure of merit gives an indication of how many times a spot may be 
used before its neighbors must be regenerated. In the tubes used the 
RAN was greater than 50 at full storage density. 

The interaction effect of spots more distant than one unit may be ex- 
pressed by a similar RAN, but it is found that this interference very 
rapidly becomes independent of distance. Thus, in the tubes used it 
was found that approximately one million operations in spots more than 





* A compiete storage operation is any of those defined in Section III. This 
definition gives RAN’s which are approximately one-half of those obtained 
using the definition given by the IRE Standards Committee on Electron Tubes. 
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three or four units removed from a given spot could be tolerated before 
errors occurred. These errors are caused by very small scale effects, such 
as reflected high-speed secondary electrons and positive ions. 

To prevent errors from this cause, a requirement was imposed on the 
system to insure that each spot was used or regenerated at least once 
each second. At a 2.5-microsecond cycle time, this limited the maximum 
number of distant interferences to 400,000. In addition, the system was 
required to regenerate more frequently any spots that had high adjacent- 
spot interference. 


4.2 Deflection System 


The deflection system receives at its input a 14-digit binary number. 
It must convert this number into two analog voltages whose values are 
proportional to the binary numbers obtained by dividing the input 
number into two 7-digit numbers. These two voltages, applied to the 
deflecting plates of the tube, provide 128 discrete levels of beam position 
in each orthogonal axis. Since the adjacent spot interference depends 
upon accurate beam positioning, a high order of accuracy must be 
maintained in the conversion process. An error greater than 0.1 spot is 
deemed inadmissible for maintaining high RAN in the store. This 
means that in a jump from the lowest level to the highest level (128 
spots) a positioning accuracy of better than 0.1 per cent is required. 

The maximum regeneration interval of one second eases the accuracy 
requirement on slow drifts, since the regenerated array can move on 
the surface of the target. However, to avoid the necessity of extra 
target area, long-term drift must be minimized. 

The requirement of 0.1 per cent accuracy has an important bearing 
on the attainable deflection speed, since the beam cannot be turned on 
until the deflection voltage has settled to within the 0.1-spot limit. To 
meet the design objectives, this must occur within 0.5 microsecond. If 
the voltage approaches its final value exponentially, this is equivalent to 
a 0.2-microsecond rise time in conventional terminology. Because of 
unavoidable overshoots, the amplifier must, in practice, be at least 
twice as fast. At the opposite end of the frequency spectrum, the response 
must extend to de because, with random access, the store may operate 
almost continuously at any place on the storage surface. 

Since accurate focusing of the beam is required for high RAN, the 
deflection system must have a minimum effect on focus. This requires, 
first, that the deflection plate voltage be applied in balance across the 
deflection plates to assure constant average potential between them. 
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Fig. 3 — Deflection system functional diagram (one axis). 


This alone is insufficient, and correction must be made for the remaining 
defocusing caused by the lens action of the deflecting plates, using 
circuitry which develops a voltage proportional to the square of the 
off-axis deflection. This voltage is then applied to the appropriate 
focusing electrodes. With the independent control in each axis offered 
by the double-focus lens, spot size can be held to a 30 per cent increase 
in the corners. 

The circuit of each axis of the deflection system consists of four main 
parts, as shown in Fig. 3. The input register consists of flip-flops which 
convert the incoming pulse into binary de levels. These levels actuate 
the digital-to-analog converter to produce a low-level analog signal 
proportional to the input binary number. These analog signals are 
amplified and applied to the deflecting plates and the focus correction 
circuit. 

The register flip-flops are identical to those shown in a later section 


TO INPUT REGISTER FLIP-FLOPS 





Fig. 4 — Digital-to-analog converter schematic diagram. 
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and are conventional Eccles-Jordan type with cathode follower outputs. 
They each drive an input of the digital-to-analog converter whose 
circuit is shown in Fig. 4. This is a well-known circuit in which there is a 
current established by each resistance from a common supply. The 
current may flow into the low-impedance lead to the amplifier or back 
into its respective flip-flop. The potential at the junction of each diode 
pair is held to within a volt or so of ground, while the supply voltage, 
+V, is approximately 100 volts. This means that there is essentially a 
constant current in each resistance and residual inductance effects are 
minimized. The action of the converter is to switch a number of these 
binary-weighted currents into the input leads to the amplifier, where 
they add to produce the desired analog voltage across the input resistance 
of the amplifier. To meet the required balanced output voltage, both 
sides of the flip-flops are used to create complementary currents in the 
two output leads. 

The accuracy of the converter depends on the accuracy of the resistors 
and the power supply. The latter must be well regulated, to at least 
0.05 per cent over a one-second period and better than 1 per cent over 
longer periods. The resistors, chosen for good high-frequency per- 
formance, are carbon film types and are not a factor in short-term 
drift. However, their long-term drift is important, particularly if they 
do not all drift equally. This could cause crowding of lines and columns 
of the storage array and serious degradation of RAN. 




















Fig. 5 — Barrier grid tube storage raster showing “plaid’’ pattern for drift 
protection. 
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Fig. 6 — Deflection amplifier schematic diagram. 


In order to permit some drift, the resistors were chosen with a weight- 
ing ratio of 2.02 between digits instead of 2.0. These result in a plaid 
pattern, as shown in Fig. 5, which occupies a square approximately 8 
per cent larger than a linear-spaced array with the same minimum 
spacing. However, a -1 per cent drift in the resistors is allowed before 
the minimum spacing is exceeded. Generally, this much protection is 
more than adequate, since the resistors tend to drift in the same direc- 
tion. 

The output of the converter drives an amplifier whose simplified 
schematic is shown in Fig. 6. To stabilize the gain of this amplifier, 
feedback from grid to plate is used. This also provides the necessary 
low-input impedance required by the converter circuit. The output of 
the amplifier drives the deflection plates of the barrier grid tube directly. 
To allow for differing deflection sensitivities, the effective converter 
supply voltage is variable. Centering is accomplished by differential 
current injection at the amplifier grid. The total swing at each deflection 
plate of the tube is about 75 volts, centered at 145 volts. To achieve 
optimum focus, the average value of the plates is adjustable by means 
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of the bias supply voltage (— V). This supply, like the converter supply, 
must be well regulated. 

To achieve an over-all deflection rise time of 0.1 microsecond with 
negligible overshoot requires careful layout of the output circuit to 
minimize stray capacity. It was for this reason that size and centering 
were placed in the grid circuit. Careful adjustment of the feedback 
capacitors permits the overall deflection system to achieve rise times of 
0.08 microsecond and to settle to within 0.1 per cent of final value in 
0.5 microsecond. 

The defocusing caused by the full beam deflection requires correction 
at the focus electrodes. Ideally, the correction should vary as the square 
of deflection deviation; in practice, a power term whose exponent lies 
between 1.5 and 2.5 is equally satisfactory. For this reason, the correc- 
tion is developed by using the approximate multiplicative action of 
grids on beam current in multigrid tubes. The circuit of Fig. 7 has input 
pentodes whose control and suppressor grids are driven by the same 
signal. Each deflection plate drives such a stage and outputs from 
corresponding plates are added. The result is very closely parabolic and 
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Fig. 7 — Focus correction schematic diagram. 
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symmetric about the center of deflection. Further amplification is 
necessary to provide the required correction amplitude. 


4.3 Control System 


During a storage cycle the change of deflection plate potential and 
focus correction must be completed before the beam is turned on. As 
previously indicated, a 0.7-microsecond period is allowed for this action. 
When this interval has elapsed the beam is turned on, with the back 
plate at its lower potential (the backplate is normally held at this 
potential). This action (see Fig. 8) constitutes both a reading and a 
writing of a 0 and occupies 0.8 microsecond. During this period, the 
output current from the collector is sampled to determine the value of 
the spot stored and, at the end of the period, the spot has been written 
to a 0. Up to this point, the action is identical for all operational modes. 
During the succeeding 0.8 microsecond the action depends on the 
particular polarity required in the write operation. The circuit may 
either remain idle and leave the 0 just written, or the beam may be 
turned on and the backplate potential raised, writing a 1. 


DEFLECTION 


BEAM 
(WRITE 1) 


BEAM 
(WRITE 0) 


BACKPLATE 
(WRITE 1) 


READOUT 


0 0.5 1.0 1.5 2.0 2.5 3.0 3.5 4.0 
TIME IN MICROSECONDS 


Fig. 8 — Timing sequence. 
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It is the function of the control circuit to time and initiate these 
actions, using the circuit whose simplified schematic is shown in Fig. 9. 
The circuit is constructed of logical gates, passive delay lines and flip- 
flops. Delay-line losses are made up by gate circuits (which have gain 
stages) either in conjunction with their normal logical function or, in 
some cases, specifically for gain purposes. Gates in the latter class have 
been omitted from the schematic. 

There are two basic gate units providing the logical ‘“‘or’’ and logical 
“and” functions; their circuits are shown in Fig. 10. They consist of a 
basic-pulse gain stage preceded by a logic stage. The basic output 
pulse is of 0.1-microsecond duration and uses 100-ohm terminated pulse 
cables with low-impedance delay lines. The output transformer of each 
unit acts as a reshaper and provides a uniform pulse shape throughout 
the system. 

The flip-flop circuit is shown in Fig. 11. This same circuit is used in 
both the deflection registers and the control circuit. 
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Fig. 9 — Logie of control section. 
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There are two special circuits in the control circuit which are used 
functionally as flip-flops but whose special requirements dictate a 
circuit different from that just given. These are called drive circuits. A 
common simplified schematic is shown in Fig. 12. 

These circuits are required to drive an essentially capacitive load 
from one voltage level to another. The change must be rapid and operate 
on the receipt of a “set’’ or “reset”? pulse. Normally the circuit is in its 
lower voltage state and is driven to its upper level for only short periods 
of time. Due to the essentially nondissipative character of the load, 
current is required from these circuits only during the transition from 
one level to another. However, to achieve the required rise and fall 
times (typically, 0.3 microsecond for a 50-volt transition across 2500 
micromicrofarads at the back plate) the peak currents required are of 
the order of one-half ampere. 

Tube V3; acts as a cathode follower and in response to a “‘set’”’ pulse 
provides a large pulse of current to cause a positive-going transition. 
Because the load is capacitive, it remains at its upper potential after 





Fig. 10 — Logic circuit schematics. 
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V; is biased off. When a return to the normal lower potential is desired, 
V, is pulsed to discharge the load. This tube must discharge the load 
sufficiently to allow V3 to become biased on and assume control of the 
output voltage. 

To assure that the output current does not drift upward during periods 
of idleness, a constant drain current is provided by V;. The width of 
the system pulses are insufficient to insure current flow during the 
entire transitions, so these pulses are stretched by the input diodes and 
grid capacity and are clipped and amplified by V; and V2. 

In the specific circuit for driving the back plate, the load is sufficiently 
large to require doubling V3 and V,. In the case of the grid-drive circuit, 
single tubes are adequate, but the lesser capacitance results in consider- 
ably more droop along the top of the pulse. Since proper operation of the 
barrier grid tube requires this top to have very little droop, the actual 
output is severely clipped by the circuit of Fig. 13 before it reaches the 


1+150 





Fig. 11 — Flip-flop circuit schematic. 
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Fig. 12 — Driver circuit simplified schematic. 


grid. This circuit clamps the grid to either — 1000 volts or to — V volts. 
The cathode bias is adjusted so that when the grid is at — 1000 volts 
the beam current is at the desired value. The supply, —V, is adjusted 
to insure the tube is cutoff when the grid is at — V volts. This method of 
clipping provides a fairly simple circuit, but a change in operating 
beam current requires a change in cathode voltage, with a resulting 
change in accelerating voltage and deflection sensitivity. In practice, 
the usable range of beam currents can be achieved by a change in ac- 
celerating potential of less than 2 per cent. For most adjustments of 
current this does not require readjustment of deflection. 
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Fig. 13 — Beam drive clamp circuit. 
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4.4 Readout Section 


The output current of the collector is of the order of 1 microampere. 
Since the required rise time of the output voltage and the collector and 
wiring capacity limit the load resistor to 2 kilohms, a voltage of 2 milli- 
volts represents the available output signal. Of this, only about one- 
third represents the difference between 1’s and 0’s. Amplification must 
be provided to achieve satisfactory discrimination between these two 
states. | 

Unfortunately, both 0 and 1 signals have a de component which 
depends upon duty factor. To make the proper discrimination, this de 
component must be preserved in the amplification process. At these 
input levels and bandwidths (the amplifier rise time is 0.8 microsecond) 
stable de amplification is not achieved simply. Fortunately, the wave- 
form is such that an ac amplifier followed by de restoration may be 
used. The schematic of the amplifier is shown in Fig. 14. The signal 
output of the amplifier for several conditions is shown in Fig. 15. 

Each figure shows the superimposed readouts from all spots in the 
store. Since the pattern of 1’s and 0’s in the store formed a checkerboard, 
half of the readouts represent 1’s and half represent 0’s. The central 
2.5 microseconds of each sweep represents a complete storage cycle 
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Fig. 14 — Readout circuit input section. 
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consisting of deflection (D), reading (R), and writing (W). This is most 
clearly seen in Jig. 15(a), where the store is operated at a low repetition 
rate. In Figs. 15(b) and 15(c) the repetition rate is 400 ke and the 
noise from the writing in one cycle extends into the deflection period of 
the next cycle. 

During the period R the differing traces represent the 1 and 0 read- 
outs and the amplitude must be sampled during this period. The store 
delivers a 1 output pulse only if the signal is more negative than approxi- 
mately —3 volts. In Fig. 15(b), where no de restoration is provided, the 
effect of the higher repetition rate can clearly be seen to be essentially a 
shift in the de level of the readouts, and the preceding discriminator 
would not indicate the presence of 1’s. Since all traces in Fig. 15(b) coin- 
cide just prior to readout, the voltage at this point may be clamped to 
the same value (0 volts) it has in Fig. 15(a), and the result is shown in 
Tig. 15(c). Here it can be seen that the discriminator will give the correct 
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Fig. 15 — Signal outputs from readout amplifier: (a) low repetition rate; (b) 
high repetition rate without clamp; (c) high repetition rate with clamp. Hori- 
zontal scale, 0.5 microsecond per division; vertical scale, 2 volts per division. 
D= deflection; R = read; W = write. 


A HIGH-SPEED BARRIER GRID STORE 1213 


readout. The actual sample of the readout is taken at the center of the 
trace and is about 0.1 microsecond in duration. The apparent improve- 
ment in the separation at this point in Tig. 15(c) relative to Fig. 15(a) 
is due to a favorable interference pattern and, in practice, the levels are 
essentially identical between low-frequency and high-frequency opera- 
tion. 

These views of the readout indicate that a more favorable sample 
might be taken earlier than at the time indicated. Unfortunately, it is 
difficult to reproduce marginal 1 signals photographically, and these do 
not show the large separation from the 0’s early in the readout period. 
The optimum time in an actual store is determined by adjusting for 
best RAN, and it is close to the indicated time in all tubes. 

The clamping circuit and amplitude discriminator are shown in Fig. 
16. Vacuum tube diodes were used to achieve fast clamping with mini- 
mum loading. The amplitude discriminator consists of a cathode follower 
driving a grounded grid amplifier through a series diode. This configura- 
tion has proved to be very accurate, stable and fast, and it has a large 
overload capacity. However, since it is not regenerative it must be 





Fig. 16 — Readout circuit clamp and discriminator section. 
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followed by considerable gain. This is shown in Fig. 17. The first stage 
is straightforward voltage gain, followed by a regenerative phase splitter. 
This circuit has characteristics similar to a Schmidt trigger circuit,’ but, 
since the feedback is ac coupled, there tends to be a small amount of 
turn-off delay. This is minimized by limiting the amplitude of the 
feedback. This stage drives a pair of diode AND gates which are sampled 
at the appropriate time by the control circuit to generate a 1 or 0 out- 
put. 


4.5 Hquipment yee 


In packaging the various circuits which constitute the store several 
objectives were sought. It was desired to evaluate the problems existing 
in an actual telephone system where continuous operation is mandatory. 
Clearly, continuous operation requires the system to have standby 
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Fig. 17 — Readout circuit output signal generation. 
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storage facilities. Since the amount of such storage depends upon the 
expected out-of-service time of faulty stores, the stores must be ar- 
ranged for simple and rapid maintenance and repair. To assure this, 
practically all components were included in plug-in packages. Excep- 
tions to this rule were made in the case of highly reliable elements such 
as delay lines, but in general the only fixed elements in the store cabinet 
were wiring and connectors. 

The control section and part of the deflection system readily divide 
into small functional units which may be packaged conveniently, but 
the other sections of the store cannot be so readily separated. If their 
breakdown is into rather small units, stray capacitance due to extra 
inter-unit wiring presents a problem in keeping within the cycle time. 
Too large a unit imposes a mechanical problem and tends to require 
excessive spare equipment. However, what proves to be the governing 
consideration is the need for grouping all alignment controls and their 
circuits on a single plug-in unit so that store realignment is not necessary 
when a package is replaced. The alignment controls in the store include 
adjustment for deflection size and centering, focusing correction and 
level, beam current, output gain and discrimination level and a few de 
parameters of the storage tube. The number of these adjustments 
requires this one package to be relatively large. 

This package, called the barrier grid tube unit, is shown in Fig. 18. 
It includes the barrier grid tube and its de circuitry, the deflection 
amplifiers, the focus correction unit and the readout section. Fig. 18(a) 
shows the partially assembled unit with the barrier grid tube centrally 
mounted in a Mu-metal box for magnetic shielding. Electrostatic 
shielding is obtained from the copper mesh placed directly around the 
tube. The deflection amplifiers are mounted on either side of the tube 
outside of the shields, and they are wired directly to the deflection 
plates. In the forward left-hand corner is the focus correction unit. In 
Fig. 18(b) is shown the unit with the Mu-metal cover and complete 
readout section in place. Fig. 18(c) shows the fully assembled unit. For 
installation, the unit rests on drawer-type slides in the center of the 
store. : 

A view of the full store is shown on the left side of Fig. 19. Below the 
barrier grid unit is the remainder of the deflection section. The individual 
flip-flop units are on the sides, while the digital-to-analog converter is in 
the center. The latter is a single unit that plugs into the rear of the store. 
Above the barrier grid unit is the control section. The uppermost unit 
~ is the combined grid and back plate drivers. 

The small functional packages in the control circuit and deflection 





Fig. 18 — Barrier grid tube unit: (a) mounting of barrier grid tube; (b) unit 
without cover; (c) fully assembled unit. 
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Fig. 20 — Construction of small packages. 


support were used. Experience has indicated that in the relatively non- 
severe type of usage encountered in this type of system a self-supporting 
card of type (c) is entirely satisfactory. 


4.6 Power Supplies 


The power supply for the store is shown on the right side of Fig. 19. 
Twelve voltage levels are used. Eight of these, which supply 75 per 
cent of the de power, are simple rectifiers achieving +2 per cent regula- 
tion through line voltage regulation of +1 per cent in resonant regula- 
tors. The remaining power is supplied by electronically regulated supplies 
meeting 0.5 per cent regulation for periods longer than 1 second and 
+0.05 per cent for shorter periods. The total de consumption of the 
store is 500 watts. 

In addition to the de power, a filament supply of 220 watts is required. 
Although these power requirements are quite modest, a largely tran- 
sistorized version of the store would offer significant power economy. 
Such a version appears to be feasible with transistors now available. 


V. OPERATING EXPERIENCE 


The laboratory operating experience with two stores over a combined 
time of 10,000 hours has been very favorable. The most difficult operating 
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aspect has been that of initial alignment. The operator has under his 
control about a dozen parameters which he must initially optimize for 
system operation. The general alignment procedure which has evolved 
is first to adjust size, shape and centering of the deflection raster. This 
presents some problems because the raster is not directly viewable and 
the effective edge of the storage area is not exactly definable. The usual 
procedure is to define the edge by, say, a 20 per cent reduction in a 1 
readout. This permits the deflection sensitivity to be measured and the 
shape and centering and approximate size to be set. The ‘‘correct”’ 
size may be set later during more sensitive tests. 

For setting focus and discrimination it is necessary to have test 
equipment available which will evaluate RAN (or an equivalent figure 
of merit) both at a point (or over a small area) and over the entire storage 
surface. The focus correction can then be determined by optimizing 
small-area RAN at the center and four sides. For setting the actual de 
level of focus, it is preferable to use an over-all RAN, since focus should 
be optimized at the point of lowest RAN. Likewise, the discrimination 
level should be set for optimization of over-all RAN. The actual align- 
ment procedure can be mechanized. However, the alignment procedure 
was an important consideration in the original store design since an 
unwanted interdependency of adjustments might have seriously com- 
plicated the procedure. 

Once aligned, the store requires little further adjustment. The stability 
of alignment has proven very good with respect to both continuous 
operation and package replacement. Prealignment of a spare barrier 
grid unit is entirely practical, although a slight amount of touch-up 
alignment is usually done after replacing this package. The only drift 
effects that have proved noticeable have been from changes in 
storage tube beam current. These, however, are easily corrected by 
periodic observation and minor adjustment. No other drifts of im- 
portant magnitude have been apparent. Observations on one store over 
2500 hours showed a drift in raster position of only one spot. 

The RAN’s that have been obtained for the store are in the range of 
50 to 60 at the worst areas of the surface. These are generally the edges 
and corners, and RAN’s of 150 are more common for most spots. No 
changes in storage characteristics have been noted over periods of 
several thousand hours. While cathode life would thus seem to be the 
main factor in limiting the life of the tubes, the small numbers of tubes 
used and the short periods involved have not permitted a complete 
evaluation of expected life. 

For the store as an entity, a measure of reliability would be desirable. 
Such measures are difficult to obtain and are often of nebulous meaning, 
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but, to the degree that they establish bounds, they are nonetheless 
useful. For the store described, tests were carried out in which known 
storage patterns were regenerated for long periods of time. From such 
tests, the store, its power supplies and its test equipment appear to 
have an error rate of approximately 1 to 2 errors every 24 hours, or about 
1 error in 10" operations. At this low rate, protection of important 
information which must be held for long periods can be assured by 
single error-correcting codes. 


VI. SUMMARY AND CONCLUSIONS 


Using a single barrier grid tube, a complete self-contained data 
storage unit has been achieved. The unit has a 16,384-bit capacity, and 
an access to any bit, including reading and writing, may be made every 
2.5 microseconds. While the specific unit was designed for serial opera- 
tion, its high input impedance makes paralleling of stores straight- 
forward. Regeneration is necessary, but the interaction between spots is 
low and not more than 10 per cent extra system time is required. 

The store has a volumetric efficiency of 4 cubic inches per bit (Gn- 
clusive of power) and a power efficiency of 45 milliwatts per bit. As a 
measure of economy, the component count (tubes, resistors, condensers, 
diodes, transformers, switches, sockets) indicates a usage of approxi- 
mately 0.1 unit per bit, of which only 10 per cent are active elements. 
Actual operation has indicated good stability and reliability. 

In the field of random access memory for data handling systems, 
barrier grid tubes can provide high-speed memory with moderately 
large capacity per tube. The resulting stores are economical and offer 
considerable promise for future electronic telephone switching systems. 
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Linear Least-Squares Smoothing and 
Prediction, with Applications 


By SIDNEY DARLINGTON 
(Manuscript received April 29, 1958) 


This paper describes the calculation of smoothing and prediction operators 
of the linear least-squares sort using techniques derived from a circutt theory 
point of view. The techniques are developed explicitly for time series which 
are continuous and statistically stationary. Other situations are explored 
more briefly, however, in which the time series are etther discrete or stattsti- 
cally nonstationary. 

For the most part, functions of time are replaced by functions of frequency, 
representing their transforms. Mathematical complications are avoided by 
restricting statistical ensembles to those which have rational power spectra. 
In practice, actual spectra can be approximated sufficiently well by rational 
spectra, and the simplified methods are sufficiently general for engineering 
applications of many different sorts. Both finite and semi-infinite smoothing 
intervals are permitted, with or without constraints of various sorts. The 
assumption of rational spectra does not apply directly to nonstationary time 
serves, but 7t may be replaced by a closely analogous restriction which does 
apply. Then there are nonstationary operations which are closely analogous 
to the stationary operations, developed for stattonary systems. A brief exam- 
ination of these analogies is of interest, even though the nonstationary opera- 
tions are usually too complicated for engineering purposes. 

The general techniques are developed in terms of specific problems, chosen 
for purposes of exposition and because of their engineering interest. 
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I, INTRODUCTION 


Tor a number of years, beginning roughly at the end of World War II, 
there has been a growing interest in theories of optimum smoothing and 
prediction. Much of the work has been concerned with optimum smooth- 
ing and prediction of the linear least-squares sort applied to statistically 
stationary time series —a subject which is both attractive to mathe- 
maticians and important in various engineering problems. 

This paper describes techniques for solving smoothing and prediction 
problems of the stationary, linear, least-squares sort using a circuit 
theory point of view. It avoids the more difficult mathematics of the 
very general, completely rigorous treatments, but maintains sufficient 
generality for many engineering applications. It develops general tech- 
niques in terms of specific engineering problems, which are of real inter- 
est in themselves and may also serve as patterns to be followed in solv- 
ing other problems. Among the problems considered explicitly are the 
following: classical smoothing and prediction problems solved by 
Wiener,’ Kolmogoroff,” Zadeh and Ragazzini,’ etc.; the simultaneous use 
of different instruments, with different error spectra, for the observation 
of single physical variables; applications of the mathematics of data 
smoothing to circuit design problems which do not actually involve data 
smoothing as such. 

The general techniques described here have been developed over a 
period of years. Some of the results have already been stated, in special- 
ized reports describing specific applications of one sort or another.*'” ° 


1.1 Further Background 


Present-day theories of smoothing and prediction may be said to 
have started with the classic papers of Wiener’ and Kolmogoroff,”’ which 
were written during World War II. They assumed linear least-squares 
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operations, stationary statistics and observations available for all past 
times. Zadeh and Ragazzini’ modified the theory for observations which 
are available only over a past interval of finite duration. By now, many 
other papers have been published, aimed at generalizing, modifying, 
interpreting or applying the original theories. A complete bibliography 
would be very extensive, and will not be attempted in this paper.* 

Differences in points of view can result in quite different formulations 
of smoothing and prediction theory, even though the formulations must 
reflect the same mathematical fundamentals. This is important, because 
the classic papers of Wiener, Kolmogoroff, Zadeh and Ragazzini, etc. 
contain quite formidable mathematics, which is not generally accessible 
to engineers. Much of this mathematics can be avoided by imposing 
certain additional restrictions, which are generally minor in terms of 
resulting restrictions on engineering applications. Further complications 
can be avoided by not requiring perfect rigor in regard to all singular, 
or mathematically “pathological” situations. This point of view is quite 
different from that adopted, for example, by Doob’ in his very general 
treatment of smoothing and prediction in terms of the general theory 
of stochastic processes. 

Bode and Shannon® simplified the derivation of Wiener and Kol- 
mogoroff’s most important result, using circuit theory concepts to inter- 
pret the mathematical operations in physical terms. Their physical inter- 
pretations are very powerful tools for engineers who must solve the 
mathematical problems and, in fact, their paper is our principal reference 
in what follows. Their method of solving the Wiener-Kolmogoroff prob- 
lem, however, does not apply to the Zadeh-Ragazzini problem or to 
various other generalizations of engineering interest (unless it 1s compli- 
cated in ways which destroy most of its advantages). Furthermore, their 
solution of the Wiener-Kolmogoroff problem itself is not simple in 
numerical applications. 

This paper uses a circuit theory point of view in a somewhat different 
way, which leads to more general applications and to simpler computa- 
tions. The advantages are obtained at the price of an additional mathe- 
matical restriction. Functions of frequency representing statistical 
‘““‘power spectra”’ are required to be rational, whereas more general theo- 
ries allow more general functional forms.} This is a minor restriction in 
most engineering applications, where nonrational functions can be re- 
placed by rational approximations. 

* For an extensive bibliography (as of 1955) see Stumper.? 

+ Bode and Shannon mention rational spectra as simplifying one part of their 


method — the evaluation of a loss-phase integral — but they do not seek other 
simplifications, which may be realized by a rather different method of solution. 
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Under the assumption of rationality, most of the analysis can be car- 
ried out in the frequency domain, in terms of the more usual operations 
of circuit theory. The concepts of generalized Borel fields, measurable 
spaces and even Hilbert spaces need not be used at all. Usually, Wiener- 
Hopf equations can be replaced by contour integrals in the complex 
plane. When Wiener-Hopf equations do appear, they may be replaced 
quickly by conditions applied to the analytic properties of functions of 
frequency. This avoids the usual difficulties with ‘6 functions” and their 
derivatives, and states conditions in forms more familiar to circuit 
theorists. Frequently, end results may be expressed as conditions which 
determine network zeros and poles more or less directly. These circum- 
stances all depend, however, on the basic assumptions of linear least- 
squares smoothing. For the simple methods, the assumption of stationary 
statistics also is essential; more complicated analogous methods apply 
to time-variable situations, at least in principle. Nonstationary systems 
are discussed in this paper only briefly, in Section 3.6. 

Tor the most part, continuous-data systems are assumed. However, 
the techniques developed for continuous data can readily be adapted to 
sampled-data problems, by methods which are outlined in Section 3.5. 
These methods have not yet been compared in detail with more direct 
methods of handling sampled-data problems such as, for example, those 
of Levinson (Ref. 1, Appendix B), and Lloyd and McMillan.” 

Chang” has described a frequency-domain equivalent of Wiener and 
Kolmogoroff’s central result. He starts with contour integration, but does 
not simplify the solution by assuming rational spectra. He does not 
extend the method to the finite memory problem solved by Zadeh and 
Ragazzini. Zadeh and Ragazzini themselves describe a solution which 
assumes rational spectra, but they use a time-domain analysis which is 
less simple than an analysis in the frequency domain. Laning and Batten” 
also describe smoothing and prediction in time-domain terms, subject 
to the assumption of rational spectra. 

In Ref. 11 Chang also points out that the mathematics of smoothing 
and prediction may be applied to network synthesis problems which do 
not actually involve data smoothing or prediction. Basically, Chang 
proposes designing to a least-squares error criterion, where the error is 
the magnitude of the complex difference between a physical transfer 
function and a nonphysical ideal function which it is to approximate. 
This appears to be a quite rewarding approach to various nonstochastic 
problems in network synthesis, particularly after the frequency- 
domain method has been extended to more general smoothing and 
prediction problems. 
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Within the general field of data smoothing, an important variation of 
the classical problem is as follows: In the classical problem, one is con- 
cerned with the optimum smoothing and prediction of a statistical signal, 
contaminated with a statistical noise, when the statistics of the signal 
and noise are known. In the variation, one is concerned with the simul- 
taneous use of two different instruments to measure a single physical 
variable or signal. In the simplest form, the readings of the two instru- 
ments are combined through optimum linear operations, subject to the 
condition that the net error is to depend only on the instrumental error. 
Then the signal statistics do not enter at all, but two different statistics 
must still be considered, corresponding to the two different instrumental 
errors. If the errors of the two instruments have quite different frequency 
characteristics, the two-instrument combination can give much greater 
accuracy than either instrument alone. This may be compared with the 
use of “woofer” and “tweeter”? speakers in high fidelity sound systems. 

The techniques described here were developed, to a considerable 
extent, in connection with specific applications of the two-instrument 
problem described in Refs. 4, 5 and 6. The two-instrument optimization 
problem was suggested by previous uses of two kinds of instruments, 
combined through arbitrary, non-optimum linear operations.* More 
recently, two-instrument optimization principles have been described 
in papers by Bendat,” and Stewart and Parks.” 


1.2 Organization of the Paper 


The remainder of this paper is organized as follows: Section IT formu- 
lates a fairly general smoothing and prediction problem in mathematical 
and physical terms. At the same time it reviews certain mathematical 
relations which will be needed in the sequel, including some elementary 
Fourier transforms, some properties of ‘‘physical’’ networks and some 
properties of stationary Gaussian noise. 

Section III develops techniques for solving the general problem. The 
techniques are explained in terms of specific problems, which are special 
eases of the general problem (or reasonable variations of it) and are 
especially suitable for purposes of explanation. Section IV describes 
other specific problems and engineering applications which have been 
chosen primarily for their practical interest. 

Some of the specific problems illustrate existing engineering applica- 
tions. Others are merely potentially useful or of interest for largely the- 

* Examples are: an instrument made by North American Aviation for the 


Sandia Corporation (which furnished a starting point for Ref. 4) and a proposal 
of Crooks. 
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oretical reasons. Some of the problems may not have been solved before. 
Others have well-known solutions, in one form or another, and are in- 
cluded purely to illustrate the generality and efficiency of the tech- 
niques under discussion. 

A more detailed outline of the paper may be seen in the table of con- 
tents at the beginning of this paper. 


II. FORMULATION OF GENERAL RELATIONS 


In this section we formulate a central problem, in about the same way 
as Bode and Shannon, and review some mathematics which will be needed 
in the sequel. In later sections, we shall modify some of the details, but 
within a set of fundamental restrictions which are included in the for- 
mulation described below. 


2.1 The Central Problem 


The central problem is as follows: We are given a time function f(é)» 
representing a signal s(t) contaminated by noise n(t): 


{OQ = s@ + nid). (1) 


The time functions s(é) and n(¢) are drawn from statistical ensembles of 
such functions, and we assume that the pertinent statistical characteris- 
tics of the ensembles are known. 

We are to derive from f(é) an estimate g(é) of s({ + a). When a is 
positive, g(¢) is a prediction of what the true signal s will be a seconds 
from present time ¢. When a is negative, a = —8 and g(t) is an estimate 
of what the true signal was 8 seconds before present time t. The opera- 
tions to be used in deriving g(¢) from f(t) are restricted in various ways. 
Then g(t) generally will not match s(¢ + a) exactly, but will be in error, 
by an amount e(é): 


g(t) = s(t + a) + e(f). (2) 


The permitted operations are to be used in such a way that g(¢) is an 
optimum estimate of s(¢ + a), as judged by a specific criterion applied 
to the statistics of the error e(¢). The problem is to find the specific com- 
bination of operations within the permitted operations which will, in 
fact, yield the optimum g(t). 

An engineering representation of the problem is illustrated in Fig. 1. 
The ‘“‘observed”’ signal f(¢) differs from the ‘‘true”’ signal s(¢) by the noise 
n(t). The observed signal is to be modified by passing it through some 
sort of device, such as an electrical network, to obtain the output signal 
j(t), which is to represent an estimate of s(¢ + a). The action of the de- 
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_ f(t)= s(t)+ n (t) “OPERATOR” g(t) ee 
(OBSERVED SIGNAL) (DEVICE) (ESTIMATE OF S(t +@)) 
Fig. 1 — A physical representation of the smoothing and prediction problem. 


vice is described by a mathematical “operator”, which is simply a 
symbolic representation of the corresponding mathematical process re- 
lating g(t) to f(t). If the device must be chosen from some class of per- 
mitted devices, this class of permitted devices will determine a class of 
permitted operators. The problem is to determine the optimum operator 
within the permitted class, as a first step in designing an optimum device. 


2.2 General Assumptions 


The specific method of analysis depends on specific assumptions re- 
garding the statistics of the signal and noise, the criterion used to define 
optimum estimates and the class of permitted operators. The six condi- 
tions stated below will be assumed throughout this paper, except in a 
few instances where certain specific departures will be noted. Other con- 
ditions will vary with different circumstances, considered in different 
sections, and will be noted when needed. 

i.* The signal and noise statistics are assumed to be stattonary. Thus, 
statistical characteristics which refer to a single time are the same for all 
times, correlations involving more than one time depend only on time 
differences, etc. 

ii. The criterion used to define an optimum estimate is to be the aver- 
age square error, or variance o” = ave é. In other words, the permitted 
operations are to be used in such a way that oc’ is a minimum. 

iii. The permitted operations are to be lznear. A linear operation, ap- 
plied to f(é), may yield a sum of terms of the following sorts: values of 
f(t) at specific times, derivatives of f(t) of any order, weighted integrals 
of f(d). 

-iv.t The “power spectra” of the signal and noise are to be rational 
functions of frequency w— real when w is real. (Power spectra are 
Fourier transforms of covariance functions.) 

v. The statistics and the permitted operations must be such that esti- 
mates with bounded average square errors are possible. 

vi. In general, the permitted operations will be an assigned subset of 
the class of all linear operations (for example, the class of all ‘‘physical”’ 

* Except in Section 3.6, which shows how the methods used for stationary 


statistics may be applied to time-variable systems of certain very special kinds. 
+ Except for possible departures in Sections 3.2.3 and 4.3. 
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linear operations). Sums and differences of permitted operations will 
always be linear operations, but they will not always be permitted linear 
operations. However, we will assume that the class Cy , of permitted 
operations Y, always has the following property: If Y; and Y2 are per- 
mitted operations and & is an arbitrary positive or negative real con- 
stant, there must always exist a permitted operation Y3 such that* 


Y3 — Y, = k(Ye maa Y)). (3) 


Conditions i, ii and iii are fundamental to the theories of Wiener,’ 
Kolmogoroff,’ Zadeh and Ragazzini,’ and Bode and Shannon.’ It is these 
conditions which make the mathematics tractable. Conditions i and iii 
are clearly appropriate for a treatment using conventional theories of 
fixed linear circuits. Under condition ii, the optimization depends only 
on linear correlations, as will be confirmed in Section 2.6. Then the ac- 
tual statistics may be replaced by any more convenient statistical models 
which have the same linear correlations. Bode and Shannon discuss ways 
in which these three assumptions do and do not limit engineering appli- 
cations. The limits should be clearly understood before practical applica- 
tions are attempted. 

Under conditions i, ii and 11, with no further restrictions, mathemati- 
cally “pathological” situations must be accounted for, and these lead 
to quite formidable (although tractable) mathematics. Condition iv, 
assumed here, excludes the more pathological situations. The resulting 
simplifications in the necessary mathematics are very substantial. While 
the requirement of rational spectra is an arbitrary restriction, it does not 
restrict engineering applications to a serious extent. The nonrational 
spectra usually encountered can be approximated sufficiently well with 
rational functions. 

Condition v is not a significant restriction on the usefulness of a design 
method. The convergence of certain integrals in which we will be inter- 
ested depends on this condition, and it is stated here for ready reference. 
Note that v does noé require convergence of the integrals of the signal 
and noise spectra alone, provided the permitted operations can lead to 
estimates with bounded average square errors. (See, for example, Sec- 
tion 4.1.1.) 

Condition vi guarantees that the optimum permitted operator will 
correspond to a “stationary point” in the usual calculus of variations 

* L. A. MacColl has shown that condition vi is equivalent to the following: 
Let Yo be any one permitted operation, and let V be the class of operations 


Y — Y,. Then V is a “linear subspace” and Cy a ‘‘flat subspace”’ in the linear 
vector space of all linear operations. 
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sense. It can frequently be simplified to the following: If Y; is a permitted 
operator, then KY, is a permitted operator. We are going to examine cer- 
tain constraints, however, which exclude the simple form. The typical 
constraint of this sort permits only linear operations Y which make no 
change in in some particular (specified) time function (for example, a 
constant, or de, signal). If fo(é) is the particular time function, and 
Y -fo(é) is the result of applying operator Y to fo(t), the constraint re- 
quires Y-fo(t) = fo(é). But then (kY)-fo(t) becomes Kfo(t), and is not 
permitted. On the other hand, (Ye — Y;) -fo(t) becomes [fo(é) — fo(é)] = 0, 
and the same is true of k(Y2 — Y;). 


2.3 Substitution of Gaussian Ensembles 


We now replace the actual signal and noise ensembles by Gaussian en- 
sembles with the same linear correlations (as permitted under assumption 
il). For a more specific physical representation, we may think of the new 
f(t) and g(é) as electrical signals (voltages or currents), provided the per- 
tinent statistical characteristics are retained. Stationary Gaussian en- 
sembles may be generated by passing white noise through (idealized) 
linear networks. Under assumption ii, the operations used to derive 
g(t) from f(é) also correspond to some linear network. Then, Fig. 1 may 
be replaced by Fig. 2. The two white noise ensembles are uncorrelated 
(assuming that signal and noise are uncorrelated). Their spectral densi- 
ties are unity (scale factors appear as gains or losses associated with the 
networks, which are permitted to include amplifiers). The linear opera- 
tions performed by the networks may be represented by frequency func- 
tions Y s(p), Yw(p), Ye(p), where p = iw. Responses to any time func- 
tions may be found from the frequency functions by means of Fourier 
transforms. We shall say more about these later on, and also about the 
properties of white noise. 
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Fig. 2 — A Gaussian physical model. 
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Fig. 3 — An alternative physical model for f(é). 


The noise sources themselves are not available to the observer, who 
sees only f(t). The noise sources and associated networks corresponding 
to Ys(p) and Yy(p) are merely imagined devices which permit the per- 
tinent signal and noise statistics to be described in physical terms. Our 
problem is to find that particular permitted Y¢(p) (regarded as a linear 
operator) which converts f(é) into the optimum g(f). 

In Fig. 2, f(¢) is the sum of two Gaussian ensembles. Since the sum of 
two Gaussian ensembles is a Gaussian ensemble, f(é) may be represented 
more simply, as in Fig. 3. This representation does not show the corre- 
lation between f(¢) and s(é) or n(t), but it will be useful in some of our 
analysis. The power spectrum of f(¢), viewed as a single ensemble, is the 
sum of the power spectra of the (uncorrelated) signal and noise. 

The auto-covariance of any one of the ensembles (signal, noise or sig- 
nal plus noise) may be specified in any one of three ways: directly as a 
function of time difference [average of s(é) s(¢ + 7), etc.]; by means of the 
power spectrum (which is the Fourier transform of the auto-covariance 
function); or by means of a network function, Yy, Ys or Yr of Figs. 2 
or 3 (from which the power spectrum can easily be computed). We will 
use the following notation: 











Ensemble Auto-covariance Function Power Spectrum Network Function 
s(t) ®s(r) S Y s(p) 
n(t) @y(r) N Yn(p) 
f@) = s@) + n@) bp (r) F=S+N Yr(p) 








Let # and Yy be any of the three spectra and its corresponding net- 
work function. Let Y(p) designate Y(—p): 


Y(p) = Y(—p). | (4) 
Then an elementary property of power spectra requires :* 
E = Yu(p)¥2(p). (5) 


We need to know how to find Ys when EF is given. In general, the rela- 
tion of Y, to H involves the general loss-phase integrals, as described by 


* Related to equations (T-9) and (T-14) of Table I, Section 2.5, and the proper- 
ties of white noise. 


LINEAR LEAST SQUARES SMOOTHING AND PREDICTION 1231 


Bode.”® Under our assumption of rationality, however, the loss-phase 
integrals can be replaced by simple relations between zeros and poles 
(also in accordance with Bode”). 

Equation (5) makes # an even function of p, and also an even function 
of w (since p> = —w’). At real frequencies, E = | Yz(iw) |? and is non- 
negative. The zeros of / occur in positive and negative pairs, like +-7, 
and —p, , and so do the poles. Of each pair, one is a zero or pole of Ys 
and the other a zero or pole of Yy . When £ is given, the zeros and poles 
can be arranged in + and — pairs, and one of each pair can be assigned 
to Y;. The possible assignments are not unique, however, unless some 
further restriction is imposed. ‘or our purposes, we will need the specific 
assignment described below. 


REAL @ 





Fig. 4 — The complex plane for p = tw. 


Referring to the complex plane for p oriented as in Fig. 4, if p, lies on 
one side of the real w axis, — 7, lies on the other side. Using ‘‘hp” to 
designate ‘‘left-half plane”, we require: 


The zeros and poles of Ys are the lhp zeros and poles of E, 
where EK = 8S, N, F. 


There may also be zeros of / on the real w axis, but these always occur 
in identical pairs, one of which goes to Yx .* 


(6) 


2.4 Properties of Physical Frequency Functions 
Let “rrhp” designate ‘regular in (the finite part of) the right-half 
plane.”’ Then an immediate consequence of (6) is 
Y, and 1/Yz arerrhp where FH = S, N, F. (7) 


* As an immediate consequence of the nonnegative character of H = | Y(iw) |? 
at real frequencies. 
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Then both Yz and 1/Yz are “physically realizable” in the general sense 
of Bode."** Under assumption iv they are realizable with finite networks 
of lumped elements, provided these are idealized to include multiple 
poles at p = © (which can be approximated within reasonable limits by 
active circuits). 

The function Ye¢(p) in Fig. 2, which converts the observed f(é) into 
the estimate g(t), may not be rational even though Ys and Yy are ra- 
tional. When a nonrational Y¢ is required to be “physical”, it must still 
be regular in the finite part of the rhp. Now, however, it may have an 
essential singularity at p = «©, and this must meet an additional restric- 
tion. 

A general definition of a “‘physical”’ frequency function, Y(p), merely 
requires that it be “causal”. A causal Y(p), applied as an operator to 
any time function f(é), produces a response g(¢) which depends only on 
present and past values of f(t). Causal frequency functions have been 
studied in very general terms, by Wiener,’ Beurling,” Nyman” and 
Youla, Castriota, and Carlin,” but the general mathematics is relatively 
complicated. A less comprehensive description of the conditions for physi- 
calness will be sufficient for our purposes. Let the definition of rrhp be 
extended, arbitrarily, to 


rrhp means: 
a. Regular in the finite part of the rhp, 


7 (8) 
b. Approaches Dom,y (Cn,~p"e ) asp — &, 
m = -tinteger, 
y = real and 20, 


Cn, + = Teal. 
Then, for purposes of this paper, it is sufficient to define ‘‘physical” by: 
A physical Y(p) ts any real function of p which is rrhp. (9) 


(A real function of p is one which is real when p is real.) 

In (8), the second condition permits Y(p) to behave like p”e” at 
p — ©, provided y is positive. Behaviors of this kind can be obtained 
with networks of lumped elements and ideal delay lines. 

We will need corresponding relations describing Y(p) = Y(—p). Let 
rlhp be defined by 

* As used here ‘“‘physically realizable’”’ includes the requirement of stability. 
This is the usual interpretation of the conventional theory of linear networks. 


An unstable linear device can in fact exist and it can be driven by an input which 
is a general function of time, but only over a finite time interval. 
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rlhp means: 


a. Regular in the finite part of the lhp, (10) 
b. Approaches Yom, 1 (Cm, yp"e'””) as p— ©, 


m = integer, 


vy = real and 20, 
Cm, 7 = real. 
Then, it follows from (8) and (9) that: 
A physical Y(p) is any real function of p which ts rihp. (11) 


2.4.1 An Essential Integral Theorem 


Bode’ has derived a number of special properties of “physical” func- 
tions, in terms of integrals in the complex 7p plane. These include the loss- 
phase relations, the integral in the definition of resistance efficiency and 
other similar integrals. One particularly simple theorem of this sort is 
essential to our method of solving smoothing and prediction problems. 

For our purposes, the theorem may be stated as follows: 


If: a. H(p) is either rrhp or rlph and as 
b. | H(iw) | = Ow” when w is real and > «%*, 


--oo 


then: H(iw) dw = 0. 


The function H(p) is not necessarily one of our network functions, 
Yx(p) or Ye(p), provided it is rrhp or rlhp in the sense of (8) or (10) 
and also meets the convergence condition. Generally, it will be a combina- 
tion of our network and spectral functions. 

The theorem is easily proved by closing the path of integration with 
an are at «. The arc encloses either the rhp or the lhp, as in Fig. 5(a) 
or 5(b), depending upon whether H(p) is rrhp or rlhp. Because of (12a) 
the integration around the closed contour is 0. Because of (12b), the in- 
tegral over the arc at ~ isO [provided y 2 0 in (8) or (10), as required]. 


2.5 Fourter Transforms 


Equations (1) and (2) describe our problem in terms of time functions, 
while Fig. 2 describes it in terms of frequency functions (and the proper- 


* The symbol O has the following meaning: if gj) = Or(w), then g(w)/r(@) is 
bounded; thus, H = Ow? means w?H is bounded. 
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ties of white noise). In general, a facility at transforming quickly between 
time-domain and frequency-domain formulations is an important tool in 
smoothing and prediction problems. Time-domain and frequency-do- 
main formulations are, of course, mathematically equivalent, and are 
related by Fourier transformations. A few elementary theorems regard- 
ing Fourier transforms which will be referred to in later sections are 
reviewed in Table I. 

In order for the Fourier transforms to exist, certain mild conditions 
must be met. We will assume, a priori, that the conditions are satisfied 
wherever we use the transforms. This is a departure from strict rigor, but 
our use of the transforms will be entirely reasonable, under our assump- 
tions iv and v. 

When Y(p) is the frequency function of a network or equivalent de- 
vice, Y (zw) indicates the steady state response to a sinusoidal input. The 
inverse transform, K(d), is the response to an ideal unit impulse, or 6 
function, applied at time t = 0. A general input time function, f(¢), may 
be thought of as a series of impulses. The effect of any one impulse on the 
response g(t) at a given time ¢ depends on the amplitude of the impulse 
and on the length of time which has elapsed since the impulse was ap- 
plied. Then , 


p00 
git) = [ft — DK) dr =f * KO, (13) 


Thus, g(t) is a weighted integral of f(¢), in which the weight factor is 
K(r) and 7 represents the “age of data’’. 
The response of a physical device cannot depend on future inputs. 


REAL p REAL Pp 


(a) (b) 


Fig. 5 — Ares at infinity, enclosing half-planes. 
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TABLE I — FourIER TRANSFORMS 





Definitions 








Fourier Transform: 
1 a ; 
Vis) = ee [. K () eat 
Inverse Transform: 


+00 


Kit) = en [ Y(iw) ett des 


Convolution: 
+o 
Ky (t) * Ke (t) = Kilt = r) K.(r) dr 


= 


Delta Function: 


+e 
6() = 0 when t+ 0, f 6() dt = 1 





Some Fourier Transform Pairs 





K(-1?) . Y(—p) = Y(p) 
kK(t) kY (p 

Kitt) + Ket) Yi(p) + Y2(p) 
5(t) 1// 2 

Kt — T) Y (p)e-?? 

Ki(t) * Ke(é) Yi(p)Y2(p) 
K(t) * K(-2) Y(p)Y (p) 

K(t) = 0, t<0 Y (p) rrhp* 
K(@) = 0, t>0 Y (p) rlhp* 





Some Related Formulas 





Parseval’s Equation: 


+o +00 
[ Ky() Ka(t) dt -[ Vay Gos 


If Y(p) = real when p is real: 
+0 +00 
i [K(t)P dw -| | Yio) |* dw 
I— 00 I— 0 


Power Spectrum = Fourier Transform of Covariance. 
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(T-1) 


(T-2) 
(T-8) 


(T-4) 


(T-14) 


(T-15) 


(T-16) 


If g(t) is the response of a linear device to an input f(t) and if g(t) = Y(p)e?# 
when f(t) = e? and g(t) = K(¢) when/f(¢) = 6(t), then Y(p) and K(¢) are a Fourier 


transform pair and, for a general f(d), 


gt) =f *«K® = K® #«fO 





(T-17) 


* Provided certain pathological Y (p) and K(t) are excluded, in a way consistent 


with our definitions of ‘‘rrhp,”’ “‘rlhp,”’ and ‘‘physical.”’ 
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Thus, (13) requires: 
If K(t) is physical, K(t) = 0 whent < 0. (14) 


When ¢ = O, K(t) need not be particularly well behaved, for it can in- 
clude 6 functions and their derivatives. If it contains nothing worse than 
derivatives of 6 functions it can be approximated with combinations of 
transversal filters and differentiators. 


2.6 A Variational Condition, Equivalent to the Optimization Requirement. 


In Figs. 2 and 3 our inputs are drawn from unit-level white noise en- 
sembles. White noise may be described in either frequency-domain or 
time-domain terms, in accordance with Rice.” In the frequency domain 
it is a sum of sinusoids of all frequencies, with phases that are completely 
random. The “spectral density”’ is constant over all frequencies. If the 
white noise is applied to a network described by Y(p) the corresponding 
output has similar properties, except that the amplitudes of the sinu- 
soids of different frequencies, w, are changed by a factor | Y(éw) | . Then 
the power spectrum of the ensemble has density EL given by the follow- 
ing (at real frequencies) : 


H = | Y(iw) ? = Y(p)¥(p). (15) 


Since phases are Initially entirely random, phases added by the net- 
work do not change the character of the ensemble. Changing the phase 
of Y(iw) without changing | Y(iw) | merely maps individual time func- 
tions into other, equally probable time functions of the same ensemble. 

The average square, o”, of the response to the white noise, is simply the 
sum of the average squares for the individual frequencies. Thus, 


4-00 foo 
fe [ | V(io) Pdo =2f | Ye) Pde. (16) 
oo v0 


Here, o’ represents both the “time average” and the “ensemble average”’, 
since the two are identical when they refer to a stationary Gaussian en- 
semble. The two ranges of integration are equally permissible, as shown, 
because | Y(éw) |’ is an even function of w.* 

In the time domain, the white noise may be described as a sequence 
of impulses, with infinitesimal spacing along the time scale. The ampli- 
tudes of the impulses are uncorrelated Gaussian random variables. An 

* It is assumed here that a spectrum F is so scaled that integrating # from 
w = —0 to +o gives the variance, o?. ‘‘Unit level’’ white noise is to be consistent 


with this assumption and (15). Sometimes the scale of E is doubled, so that inte- 
grating F from w = 0 to » gives o?. 
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impulse at time ¢ — 7 contributes to the response of a network at time 
tin proportion to K(r) and o° may now be expressed as the sum of the 
average squares contributed by the individual (uncorrelated) impulses. 
When limits are taken properly, the result is: 


+00 
=| (K(f at (17) 


Equations (16) and (17) are, of course, consistent with (T-15), in Table 
I, which is a special form of Parseval’s equation. 

Referring again to Fig. 2, if the output g(t) is interpreted as an esti- 
mate of the true future signal s(¢ + @), the error e(¢) must be 


e(t) = g(t) — s(t + a). (18) 





WHITE NOISE —— > 
SOURCE NO.1 


Fig. 6 — A physical model for the calculation of the error e(é). 


We may think of e(¢) as the output of the (unattainable) circuit shown in 
Fig. 6, in which the responses of the different parts are again described in 
frequency domain terms.* The average squared error o” is now the sum 
of the contributions from the two uncorrelated white noise sources. 
Evaluating these in terms of (16) gives 


e=f[ (\YoPN+|¥o— eS) dw, (19) 


The optimization problem may now be stated as follows: Given the 
class of permitted functions Y g¢ corresponding to all networks of the per- 
mitted sort, find the particular Y¢, say Yy,, such that o” is a minimum. 
Assume tentatively that Y » exists and let Ay(p) be defined by 


Yelp) = Yup) + Ay(p). (20) 


* When a > 0, the box marked e*? is nonphysical, since e*? corresponds to a 
negative delay, or ideal prediction. So long as the noise is present, the box is 
connected to an unavailable signal source, s(é) without n(¢), whatever the value of 
a. These circumstances are what makes e(¢) the error, instead of an observable 
correction which could be used to determine s(¢ + a) exactly. 
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Under assumption vi, if Y¢(p) in (20) is a permitted Y¢(p), then 
Y xe(p) + kAy(p) 


is a permitted Y«(p), where & is any positive or negative real constant. 
Substituting Ys» + kAy for Y¢ in (19) gives: 


. 00 
o = | (| Ya)? NM + | Ya — e% |? S) dw 


+00 : 

+f (N +S) | dr |? deo 
=) (21) 
+00 : _ 

4k i [Ya(N +8) — e*S]Xy de 


+00 ; 
+ if [Yu(N i S) — e “"’S]Ay dw. 


In this expression the last two integrals are equal, for the following rea- 
sons: First, each of the two integrals is real, for the imaginary part of the 
integrand is always an odd function of w. Second, the two integrals can 
at most be conjugates of each other, since their integrands are conjugates 
at real w. Replacing the two integrals by twice the first leaves 


+0 . 
é= | (|¥a PN +1 Yu — e®” PS) dw 
boo 
+8 W+5)|4r Pde (22) 


-f00 ; a 
+. 2h i; [Ya(N + 8) — e%S]Xy de. 


When k = 0, Ya + kAy = Ya, and o must be a minimum. This will 
be true only if the coefficient of & in (22) is zero; hence the third integral 
must be zero. Furthermore, for Y x to be a true optimum, the integral 
must be zero whatever permitted Yg¢ is used in (20) in determining Ay. 
If the variable of integration, w, is replaced by p = tw (for convenience 
in what follows), this requires: 


For every permitted Ay : 
+100 
[ [Yu(N + S) — e*?S]Ay dp = 0. (23) 


Our principal concern, in Sections III and IV, will be the solution of 
(23) for Y» , for different classes of permitted functions Y, . Generally, 
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the class of permitted functions will exclude the obvious solution which 
makes the bracket, [| ], in (23) identically zero. Then the integrand will 
not be identically zero, but will have to be such that the integral will be 
zero for every Ay which may be derived by using a permitted Y¢ in 
(20). 

When (23) is true, (22) may be written as follows, for every permitted 
V3 : 


“00 
Page Kf (N + 8) | Ay deo 
> (24) 
+20 
Gir = [ (| Yor PN + | Vx = a ?S) dw. 


Here ox is the o achieved with Yg = Ys, and the second term in o’ is 
clearly nonnegative. 

Equation (24) implies the following situation: Under assumptions v 
and vi, a true minimum variance oy’ exists (at least as a limit of a se- 
quence of o”s corresponding to a sequence of permitted functions Y¢). 
Any solution of (23) for Ys, within the class of permitted functions Y¢ 
must yield the true oy. Since N + S is nonnegative in (23), no other 
permitted Y¢ can yield a smaller o”. When N + S is also nonzero at real 
frequencies, no other Y¢ can yield as small a o’, and the solution for Y » 
is at once unique. 

When N + S is zero at one or more real frequencies, the situation re- 
garding uniqueness is not so clear, for any Ay which is nonzero at those 
frequencies but zero at all other real frequencies will lead to a new Ye, 
yielding the same o” = ox. Under assumption iv, N + S can be zero 
only at discrete frequencies. As a result, if there are two solutions for Y a 
in (23), at least one must include transfer functions of filters with in- 
finitesimal bandwidths. It is questionable whether zero-bandwidth filters 
may be called “‘physical’’; in any event, they cannot be built and alter- 
native solutions do not reduce o;,. Accordingly, any solution of (23) for 
Y x, which does not include transfer functions of zero-bandwidth filters 
will be called unique, whether or not N + S has zeros at real frequencies. 

Certain statements about convergence will be useful later on. Under 
assumption v, Y » will make o’ finite. In seeking Y x , then, we may start 
by excluding all Y¢ for which o” = ©. Since the two integrals in (24) 
are nonnegative, o” will be bounded only if both integrals converge. Each 
of the two integrands is a sum of two nonnegative terms. It follows that 
each term must meet convergence conditions. Combining these yields 
an additional useful condition, which will be satisfied by the integrand in 
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(23). The five conditions may be written collectively as follows: 


When w is real and — o the following five func- 


tions = Ow ”:t 
[Ya l N; \Ya—e? PS 
[Ay [/N;  [Ar[S (25) 


[Yau(V =r S) = e°? S]Ay 


2.6.1 An Equivalent Formulation in the Time Domain 


Time-domain equivalents of (23) and (24) can easily be derived. The 
above analysis can be paralleled in time-domain terms or, alternatively, 
(T-14) and (T-15) of Table I can be applied directly to (23) and (24). 
Let Ke(é), Kau(t), Ax(t) be the inverse transforms of Y¢(p), Yu(p), 
Ay(p). Then (23) becomes: 


For every permitted Ax , 
+00 
[| Ku) « P(r) = Br + aes) dr =0. (26) 


Equation (24) can be transformed into various time-domain equivalents, 
of which the following is perhaps the most interesting: 


Il 


+00 
a om + | [Kr + Axl’ dr, 
. (27) 


I 


[ 7 {(Kay * Ky)? + (Kay — 6(7 + @)) * Kg]"} dr. 


Ou 


2.7 Breadth of the Optimum 


The Y a determined by (28) may or may not be realizable with a finite 
network of lumped elements, even though assumption iv insures that 
Yy and Y¢g of Fig. 2 could be so realized. When Y » cannot be realized 
with a finite network of lumped elements, it may be necessary to replace 
Ym by a reasonable approximation to it, which can be so realized (and 
similarly for equivalent nonelectrical devices). A reasonable approxima- 
tion will be one which can be realized in a reasonable way, and which 
makes o’ only a little greater than the minimum, ox’. 

The approximation of general ‘‘physical’” network functions with 
‘finite network approximations” is a familiar problem in general network 


t Recall the meaning of O noted in Section 2.4.1. 


LINEAR LEAST SQUARES SMOOTHING AND PREDICTION 1241 


theory, which need not be developed here. In this connection, however, 
it is Important to note the situation described briefly below. 

In engineering problems, the minimum exhibited by o’ as a function 
of Yg¢ is usually quite broad. In other words, Y¢ may be made quite a 
little different from Y,, without increasing o” very much. This has not 
been proved but is simply a matter of experience in problems of the en- 
gineering sort (and, in fact, it cannot even be stated exactly without 
assigning a more quantitative meaning to the expression “broad mini- 
mum’’). 

A broad minimum does not mean that all small departures from Y y, 
have small effects on o”. For example, a change from order ¢/p” at p = ~, 
to order of c/p”” may yield only small departures from Yx(p) at all 
real frequencies, but it is likely to change o = oy, into o° = «. Gener- 
ally, reasonable percentage changes, relative to the magnitude of Ys, at 
corresponding frequencies, may be tolerated. The percentage changes 
may be frequency-dependent, and may be real or complex. The specific 
sensitivities to changes, however, will depend on the specific values of 
N and S. 

The effect of specific departures from Y,y, , in specific problems, may 
be calculated by means of (24) or (27). 


IlI. GENERAL TECHNIQUES, IN TERMS OF SPECIFIC PROBLEMS 


The remainder of the paper describes the calculation of Y » from (28), 
and modifications thereof. The specific Y » determined by (23) depends 
on the class of permitted functions Y¢ , within which Y y is to be the op- 
timum choice. A number of different classes are of interest, on both 
theoretical and practical grounds. Furthermore, the appropriate tech- 
niques for calculating Y 4 vary with the permitted class, in ways which 
are likely to be nontrivial. 

In this section we consider some fairly general classes of permitted 
functions, which will illustrate general techniques. In Section IV we shall 
examine variations and special cases, chosen primarily for their engineer- 
ing interest. 

In describing the properties of the different classes, it will be convenient 
to use the following general notation: 


a. Cy = the class of permitted functions Y¢, within which Y x 
is to be the optimum choice; 


(28) 


b. Cy = the class of functions Ye: — Yeo, where Yq and Y¢ 
are any two Ygin Cy. 
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Fig. 7 — The optimum nonphysical impulse response when £ is large. 


The class C's is completely determined by the class Cy . In terms of C4 , 
assumption vi of Section 2.2 may be written as follows: 


If Ayisin Cy, kAy isin Cy. (29) 


3.1 Optimum Nonphysical Network 


The integral in (23) will surely vanish if the integrand is zero identi- 
cally for every permitted Ay . The integrand will be zero if 


Vu => vos e°? (30) 
This Y, , however, is generally nonphysical. First, it is not generally 
regular in the finite part of rhp. Second, when a > 0 it behaves improp- 
erly at p— ©. 

When a is negative, Y » behaves properly at p — ~, but there are still 
singularities in the rhp [except when S/(N + S) is a constant]. Let a 
equal —@. Then g(¢) is an estimate of s(¢) for a time 8 seconds in the past. 
If 6 is sufficiently large, Y » can be approximated closely with a physical 
Y.* This is illustrated in Fig. 7, in time-domain terms. Note that the in- 
verse transform of Y x is symmetrical about the time ¢ = 8, which repre- 
sents the length of the time interval from the time for which the signal 
s(t — 8) is estimated up to present time ?. 

A large 8 is appropriate for reducing data long after they are collected, 
such as reconstructing the flight of an experimental missile from recorded 
positions or velocities. Then @ is the length of time by which the interval 
of observation extends beyond the time for which S is to be estimated. 


* See Ref. 9, Section V. 
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When the Y a, of (30) is used in (24), the minimum average square error 
is (after some simple manipulation) 


pte + NS 
. ee NS 


Then assumption v of Section 2.2 requires 


NS 
N+S8 
The same restriction on N and S will surely still be necessary (although 
perhaps not sufficient) when the choice of Ys, is restricted to any subset 
of the present Cy . 


dw. (31) 


= Ow” whenw— ~. (32) 


3.2 Optimum Physical Network 


In this section, we restrict the function class of Cy , from which Y x 
is to be chosen, to the “physical” subsct of the class permitted in the pre- 
vious section. 


Cy = the class of all physical frequency functions. (33) 


by “physical”, we again mean rrhp as in (8) and (9). Since the difference 
of two rrhp functions is also rrhp, (33) implies 


Cy = the class of all physical frequency functions. (34) 


The integrand in (23) can no longer be identically zero for all the Ay 
permitted by C4, but the restrictions on Ay are such that they may be 
taken advantage of, in one way or other. Note that the C4, of (34) obeys 
(29), and hence also our assumption vi. 

The optimum Y » may be determined in the following way: First, (33) 
is applied to (23), to obtain tentative conditions on Y y which are con- 
sistent with (83) and in which Ay does not appear. As derived, these are 
sufficient conditions. Any corresponding Y 4, , if one exists, must be the 
correct Ys, , but it is not at once apparent that one does exist. The neces- 
sity of the conditions is then established by demonstrating that a corre- 
sponding Y x, does, in fact, exist. (Recall that the correct Ys is unique.) 
This is a procedure which is useful in many variations of the smoothing 
and prediction problem. 

The integral in (23) will be zero if its integrand behaves like H(p) of 
(12). By (25), the integrand behaves properly when w is real and > o. 
By (33), the factor Ay in the integrand in (23) is rlhp. Therefore, if the 
remaining factor in the integrand in (23) is made rlhp both (12a) and 
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(12b) will be true, and (23) will be satisfied. Assembling this condition 
with (25) and (33) gives the following set of sufficient conditions on Y » : 


a. Yu is rrhp, 


b. Yu (N + S) — e°?S is rlhp, ae 
c. When w is real and > ©, 


|\YufPN and | Ya —e??S = Ow’. 


It remains to be shown that a Y » meeting (35) does, in fact, exist. The 
demonstration is somewhat different for positive and negative values of 
Qa. 


3.2.1 Prediction for a Present or Future Time (a = 0) 


When a is positive in (35b) the behavior of e*’S as p — © is consis- 
tent with rlhp. Then Yx(p) may reasonably be rational (under our as- 
sumption of rational N and S). When Y » must be physical and a is non- 
zero and positive, | Ya — e*? |’ cannot — 0, when w is real and > ©. 
Then assumption v, as reflected in condition (25), requires S = Ow” as 
w — ©. (The limiting case of a = 0 will be examined later.) When 
S = Ow’ as w > ~, conditions (35) can easily be translated into the 
following set, which refers to poles and zeros in the finite part of the p 
plane: 


a. The poles of Ya are the lhp zeros of N + S, 
b. At the lhp poles of N and S 


Yu => a8. en (36) 


c. The degree of the numerator of Y x is a mini- 
mum,within conditions a and b. 


These conditions determine a Y y uniquely. The Y » so determined will 
also satisfy (85), provided the degree determined by (86c) is such that 
(35c) is satisfied. It is shown below that (36c) is, in fact, just consistent 
with (35c). 

Recall that N and S are even functions, with half of their zeros and 
poles in each half plane. Also, YYar, which is | Ya, |’ at real w, is an 
even function, in which exactly half of the zeros and poles are zeros and 
poles of Ya. Then, under (36a), the number of (finite) poles of YY x 
is exactly the number of (finite) zeros of (V + 8S). On the other hand, 
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the number of zeros of Ya, is one less than the number of lhp poles of 
N + S, for the seale of Ys, can be adjusted, as well as the zeros, in meet- 
ing (35b). Then the number of zeros of YY y is exactly two less than the 
number of poles of N + S. As a result, 


| Yar P(N + 8) c/o asw— @. (37) 


Finally, since N and S are nonnegative at real w (and hence cannot cancel 
each other at w — «), both 
(38) 


|\Ya)N and |Yu|’?S = Ow’ asw— . 


Since we already know that S = Ow ”, this is sufficient to establish (35). 

Conditions (86) need further interpretations for special cases. When 
zeros or poles of N + S occur on the axis of real frequencies, they occur 
in identical pairs.* One of each pair is to be interpreted as in the lhp. 
Certain zeros of N + S may coincide with poles common to N and S, 
when they are computed from the numerators and denominators of the 
(rational) N and S. Lhp zeros of this sort are to be retained as poles 
of Yar .T 

When a = 0, the second condition in (35c) becomes | Yar — 1|?S = 
Ow’ as w > ©. So long as S = Ow” as w > ©, conditions (36) are 
still appropriate. Now, however, S may be nonzero, or even unbounded 
at w = o. When S is nonzero but bounded, Yy— 1 as w— «©. When 
S has poles at ©, (Ya — 1) — c/p”. When (86) is properly modified 
to include the new conditions, a unique Y x is again determined, which 
again satisfies (85), provided N is such that (32) is still satisfied. When 
S =~ Oat , however, (32) will not be satisfied unless N = Ow” as 


W—> 0, 
3.2.2 Estimation for a Past Time (a < 0) 
If a = —£, (35) becomes: 
a. Yu is rrhp, 
b. Ya(N + S) — e*?S is rhhp, (39) 
c. When w is real and > ~, 
[Ya?N and |Yu—e? 2S = Ow” 


When £ is positive, e °”S does not behave at infinity in an rlhp manner, 


* A necessary consequence of the positiveness of spectra N and S. ; 
{ This is confirmed by (860), which makes Y3, infinite at a lhp pole of S which 
is cancelled by a like pole of Nin N + S. 
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as defined by (10). Hence Y.(p) can no longer be rational, but must 
contain a term which annuls the forbidden behavior at infinity. 
Let Y x» be represented as 


S ge PP 
N+8° 


Then, if (89c) is rearranged with due regard for (32) and the positiveness 
of N and S, (89) now becomes 


Yy=A+—— (40) 


S en 
a A + —— V+ vag? is rrhp, 
b. AWW + S) is rlhp, (41) 


* When w is real and > o, 
| A ['(N + 8) = Ow”. 


The function A can now be factored, recalling Y, of Scction 2.3 and 
Fig. 3: 


YrY¥r = N+ or 


(42) 
Y,y,1/Y,r are rrhp. 


We can multiply the function in (4la) by Y,, without changing its 
rrhp character. (If rrhp, it will remain rrhp; if not rrhp, it will remain 
not rrhp.) Similarly, we can divide the function in (416) (arbitrarily) 
by Yr. Then (40) and (41) may be written as follows [if (42) is again 
used]: 


Yun ye (Btoe ) 


SB. oie 
a. B + —e”” isrrhp, 
P (43) 


F 


b. B is rlhp, 
c. When w is real and > ~, |B’ = Ow”. 


The conditions (438) can only be realized with a unique rational B. 
The poles of B are in the rhp but they are cancelled in Y x by poles of 


* This may be derived in the following way: Use the Yx of (40) in the two func- 
tions in (39c). Add the two functions, rearrange, and separate out the function in 
(41c), making use of the following theorem: Let U; and U2 be two functions of w; 
if U1 = Ow? and U2 = Ow, then U; + U2 = Ow™*; conversely, if Ui | U2 = 
Ouw-?, and both U; and U2 are “nonnegative, then U; = ’ Ow? and U2 = Ow. 
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S/Y¥». Because the poles of B are in the rhp, Yy cannot be realized 
exactly by a finite network of lumped elements and delay lines. It can 
be approximated arbitrarily closely, however, by transversal filter tech- 
niques. 


3.2.3 A Time-Domain Interpretation 


A time-domain interpretation of Y x, may be derived from (85) which 
coincides with, for example, Bode and Shannon’s interpretation.” This 
may be accomplished by using the functions Yr and Y, much as in the 
previous section. 

Since Y, and 1/Y, are both rlhp, the function in (35b) may be multi- 
plied by 1/Y without altering its rlhp character. (If rlhp, it will remain 
rlhp; if not rlhp, it will remain not rlhp.) Then (35b) becomes 


YuYr — S e*? isrlhp. (44) 
Yp 


By (T-13), the inverse transform must be 0 when ¢ > 0. Hence, the two 
terms in the difference must be equal when t > 0. Since Yy and Yr are 
both physical, YsY,r is physical and its inverse transform must be zero 
when ¢ < 0. Then (41) becomes, by (T-10), 


Ky * Kp = inverse transform of & e*? when t > 0 
F (45) 


= 0 whent < 0. 


Equation (45) determines Ky *« Ky uniquely. The transform is YxYr, 
and Ys, can be found by dividing out the (minimum phase, physical) 
factor Y» . Note that (45) can be solved for K x, even though the spectra 
are nonrational: F = N + S must be such that Yr can be found from 
F = YyY,r by means of the loss-phase integral; and various transforms 
and convolutions must be evaluated. 


3.2.4 A Further Interpretation 


A further interpretation of (45) is useful when one seeks certain gen- 
eralizations of the present problem. The time series which are funda- 
mental to the problem are the true signal s(t) and the observed signal 
f(t). When s(¢) is to be predicted for a specific time, ¢ + a, from values 
of f(t) observed over a specific interval, (— «0 < 7 < 2), only certain 
of the linear covariances, describing statistical characteristics of s and 
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f, are actually pertinent to the problem. The pertinent linear covariances 
are: 

1. the auto-covariance of the observed signal f at any two times, t, , 
t2, in the observation interval; 

2. the cross-covariance between f at any time, ¢; , in the observation 
interval and s at the special time ¢ + a; 

3. the expected value of s’, which is the zero lag covariance of s, at 
the special time ¢ + a. 

The auto-covariance function ®,, or the corresponding spectrum S, is 
pertinent to our present problem only as it affects the covariances of f 
through the relation f(t) = s(é) + mi(Q). 

It follows from the above that the original Gaussian model may be 
replaced by any other Gaussian model which retains the same pertinent 
linear covariances, without affecting either Y or oa. For example, the 
model represented by Tig. 6 may be replaced by that shown in Fig. 8. 
The network with frequency function Yy generates an f(t) with the 
correct auto-covariance (in accordance with Section 2.3 and Fig. 3). The 
network with frequency function Yrs, in the presence of the other 
network, supplies the correct cross-covariance between f(t) and s(t + a). 
(The cross-covariance arises from the sharing of the same white noise, 
by s and f.) Note that Ys in Fig. 8 is exactly the function (S/Y re”? 
in (44). The single (time-invariant) Gaussian random variable v, con- 
tributes only to s, and gives the correct variance of s when added to the 
contribution from the white noise. Note that the variance of v, is exactly 
the ow of Section 3.1, corresponding to the optimum nonphysical Yy . 


Vs : s(t + a) 







€ (t) (ERROR) 


Yr 


Fig. 8 — An alternate physical model, which retains the pertinent covariances. 
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Because Yr has been chosen in such a way that 1/Y, is physical, the 
white noise of Fig. 8 can be recovered. If YuYr = Yrs, the estimate 
g(t), of s(t + a), is exactly the contribution of the white noise to s(t + a), 
and the error in the estimate is exactly v,. If Ys must be physical, 
Y wY,r can yield only the contributions to s(é + a) from present and past 
values of the white noise. This is roughly the description of the solution 
used by Bode and Shannon (in Ref. 9, Section VII). 


3.3 Optimum Network with a Finite Memory 


In Section 3.2 we assumed that all past values of f(t) (the signal plus 
noise) were available, back tot = — ©. Furthermore, the Y »(p) of (35) 
does generally lead to the utilization of all past values. In practical 
applications, the corresponding K y(7) is usually very small when the 
age of data 7 is sufficiently large, say 7 > 7m ; and data older than 7» 
may reasonably be neglected. Frequently, however, f(¢) is available only 
for a smaller interval, say 0 < 7 < 7’; and then the procedure must be 
revised. This is the central problem considered by Zadeh and Ragazzini.’ 
It may be referred to as the “finite memory” problem, as opposed to 
the “infinite memory” considered in Section 3.2. 

We can restrict ourselves to values of f(é) no older than 7 by making 
our function class Cy correspond to physical networks with memories 
which extend only T seconds into the past. With fixed networks of this 
sort, 7’ is constant, and the used data begins at a variable time ¢ — T. 
When f(é) is available from a fixed starting time, f , to present time f, 
T is a function of t. Then a variable network must be designed with a 
response which equals or approximates the response of a different fixed 
network at each different ¢. 

Our smoothing and prediction device will remember only 7’ seconds 
into the past if the impulse response K g is restricted by 

K,(t) = 0, except when 0 <t<T. (46) 
An equivalent frequency domain restriction may be derived as follows: 
Referring to Fig. 9, if K¢(#) = 0 except when 0 < ¢ < T;, it follows that 
K«(—t) = 0 except when —T7 < ¢ < 0. But then K,[—(¢ — T)] = 0 
except when 0 < ¢ < TJ’, which meets the conditions for physical- 
ness. If Yq is the transform of Kg, then Yee” is the transform of 
K.{—(¢ — T)], by (T-5) and (T-9). Thus (46) corresponds to 


Cy is the class of functions Y¢(p) such that: 
a: Ye is rrhp, 


: (47) 
b. Yoe *? is rrhp. 
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Since differences of K,’s of the form (46) also obey (47), it follows that 
C's is the class of functions Ay such that: 
a. Ay is rrhp, 
~ Tp (48) 
b. Aye °? is rrhp. 
Note that (48) is consistent with (29) and hence also with assumption 
vi of Section 2.2. 

The following is an important property of functions in the class (47): 
Replacing Y¢ by Y¢ maps singularities from either half plane into the 
other. Then (47) excludes singularities from all finite parts of the p 
plane. Let rfpp mean “regular in the finite part of the plane”. Then, 
(47) implies that 

Yqisrfpp. (49) 


There will be no Y x of the class (47) which satisfies (35). Hence, a new 
relation must be derived from (23). To take advantage of (47), Ya may 
be expressed in the following arbitrary way: 


Vee ae Be. (50) 


If this expression is used in (23), the integral in (23) may be divided into 
two parts, as follows: 


+ic0 +i 
[ (aw +8) —eSlarap + [BIW + S)le?*Ar dp = 0. (61) 
The two integrals in (51) will be zero, individually, if the two integrands 
behave like H(p) of (12). This will be true under conditions noted below. 

In the first integrand, Ay is rlhp. In the second, Aye”? is rrhp by 


Ke (t)—> 
Ko (-t) > 
Ke[-(t-T) ] —> 


+ 


(o) 


ce) fics T ~-T Foye O jock 


Kg (t) = INVERSE TRANSFORM OF Y (Pp) =O WHEN t <0 
Kg (-t) = INVERSE TRANSFORM OF Y(p) =O WHEN t >0 


Ke[-(t-T) ] = INVERSE TRANSFORM OF Y(p)e7 TP =O WHEN t < 0 


Fig. 9 — Impulse responses of finite duration. 
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(48). For (12a) to be true, the other factor in each integrand must be 
regular in the same half plane. The convergence condition (12b) must 
also be applied, and it can be applied if (25) is properly taken into ac- 
count. When (47) also is transcribed the following conditions may be 
assembled as sufficient conditions on A and B: 


a. A + Be™ is rrhp, 
b. B+ Ac ™ is rrhp, 
c. A(N + 8) — e*?S is rlhp, 
d. B(N + 8) is rrhp, ~ (52) 


e. When w is real and — ©, the following functions = Ow”: 
|A PN, |A —e? /S 
| BPN, | B/S. 
Functions A and B which satisfy (52) do, in fact, exist; hence the 


conditions are necessary as well as sufficient. As in Section 3.2, the 
solution takes different forms for positive and negative values of a. 


3.3.1 Prediction for a Present or Future Time (a = 0). 


When a is positive in (52c) A and B are rational. By the definition of © 
rrhp in (8), conditions a and b will be satisfied if the rational A and B 
satisfy (49). When S = Ow as w— © (as it must if a is nonzero and 
positive), (52) may be translated into the following set of conditions, 
which refer to poles and zeros in the finite part of the p plane: 


a. The poles of A and B are the zeros of N + S, in both half planes, 
b. | At the lhp poles of N and S 
_.8 » 
N+S8S  ° 
c. The rhp poles of N and S are zeros of B, 


d. At the poles of A and B (53) 


—Tp 
=e€é6 ; 


bol 


e. The combined degrees of the numerators of A and B are to be as 
small as possible and the relative degrees are to be adjusted as 
required by (52e). 
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K(t) 





Ka(t) = INVERSE TRANSFORM OF A(p) 


Kp(t-T) =INVERSE TRANSFORM OF B(p)e7TP 


Fig. 10 — Inverse transforms of A and Be-7?. 


An analysis of degrees, as in Section 3.2.1, shows that (53) determines 
a unique A and B, which satisfy (52) when S = Ow” as w > ©. When 
a = 0, S is not necessarily 0 at «©. Then (52e) imposes additional condi- 
tions on A. When (53) is suitably modified to include these new condi- 
tions, a unique A and B are again determined. 

It is interesting to examine the forms of the inverse transforms of A 
and Be’, which together make up the inverse transform K y(t) of 
Y »(p). The inverse transforms of general rational functions are equal 
piecewise to sums of exponentials. The exponentials are different for 
t > Oandt < 0, and there may be discontinuities (and also 6 functions) 
at t = 0. In Be~’?, the discontinuities are displaced to £ = 7. Then the 
two time functions may take the form suggested in Fig. 10. 

As in Section 3.2.2, Ya, cannot generally be realized with a finite net- 
work of lumped elements and ideal delay lines. It can be approximated 
by a transversal filter; plus differentiations if K (¢) is not a bounded 
function. The transversal filter need not involve transmission times 
greater than 7’. If preferred, the rrhp parts of A and B can be separated 
out and realized with a finite network of lumped elements plus a single 
delay line. 


3.3.2 Prediction for a Past Time (a < OQ). 


When a = —8, (52c) excludes a rational A. Recalling (40), we let A 
be 


S BP 


AS De ee 


(54) 
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Then when a = — 8, (52) becomes the following :* 


e°? + Be ™ is rrhp, 





WER 


b B+ De*? + ——— Nv * wa? e ‘©? is rrhp, 


D(N + S) is rlhp, 
d. BIN + S) is rrhp, 


= 


(55) 


e. When w is real and > ~, the following functions = Ow” 
|D|'N, |D/S 
| BPN, | B |S. 

Consider the term ¢ ““®” in (55b). When 8 < 7, the exponential 
behaves at © in a manner suitable for an rrhp function, as defined in 
(8). Then D and B are both rational, and can be calculated from zero 
and pole conditions implied by (55). 


When 6 > 7, the exponential ¢ ‘ ”” is not suitable for an rrhp func- 
tion, and it must be annulled by an exponential term in B. Let 


_ _ S —(B-T) p 
B=J Was? (56) 


Using both (54) and (56) in (50) and (52) gives 
Yw => D -- deo? 


a. D+ Je” is rrhp, 
b. J + De™ is rrhp, 
c. DIN + 8S) is rlhp, 


(57) 
d. J(N + 8) — Se”? is rrhp, 


e. When w is real and > ©, the following functions = Ow ~ 
|D/N, |DI’s 
Lon, [eee oP RS: 
When 6 > T, D and J are rational, and can be found from (57). 
A comparison of (57) and (52) indicates the following relationship:f 
* Because N and S are even, N= Nand S =S. 


+ In making the comparison, recall that Y is rrhp when Y is rlhp, and vice 
versa. 
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If Vx is the optimum Yg for estimating s(t + a), then Y ye"? (58) 
is the optimum Yg for estimating s(t — T — a). 

The two times, ¢ + a andt — T' — a, are symmetrically located relative 
to the interval ¢ — 7 < 7 < t, for which values of f(¢) are available. 
The relation (58) may be viewed as a direct consequence of the sym- 
metry of auto-covariance functions. 


3.3.3 A Time-Domain Interpretation 


In Section 3.2.3 we derived Bode and Shannon’s explicit time-domain 
solution of the infinite memory problem. When memories must be finite 
there are difficulties which exclude an explicit time-domain solution of 
the same sort. The difficulties themselves are informative, however, and 
a simple time-domain analysis also furnishes an alternative derivation 
of (52). 

The starting point is now (26) in place of (23). Like Kg, Ax is now 
restricted by (46). Then the limits of integration may just as well be 
reduced to 0 < 7 < T and (26) becomes 


[ule # (2) — ar + ad]dxle) dr = 0. (59) 


The variation function Ax can have any arbitrary values at times within 
the interval of integration. Therefore, the other factor in the integrand 
must be zero, over the same interval 0 < 7 < 7’. Referring to Fig. 11, 
we may divide it into two parts, one of which is zero when 7 > 0, 
and the other when 7 < 7’. These may be written as follows: 


Karr) * ®r(r) — Os(7 + a) = Ko(r) + Ky(r — 7), (60) 





Ky(t) Ky(t-T) 


K(t)—» 


0 T te 


Ky(t) = 0 WHEN t>0o 


Ky(t) = 0 WHEN t<o 


Fig. 11 — The functions K, and K,. 
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in which 
Ko(r) = 0 when 7>0, 
Ky(r) = 0 when 7 <0. 


Take the transform of both sides of (60), and recall that the trans- 
forms of Ky, Pr, Bs are Yxy, N + S, S. Then 


Y u(N + S) = eS => U + Ve 7? , 
U is rlhp, (61) 
V is rrhp. 


Compare this with (35b) of Section 3.2. 

In Section 3.2.3, we divided (35b) by Yr to obtain (44) and a simple 
physical interpretation. What happens if (61) is divided by Yy? The 
result is as follows: 


a U V —T 
YuYr — aon. a — + = 6 
MIF 2 i, y, 
U/Yr is rlhp, (62) 


V/Yr is not rrhp. 


Because V/Yy is not rrhp, the inverse transform of the left-hand side 
is not zero in the interval 0 < + < T (nor in any other significant inter- 
val). Furthermore, while a Y.,;Y, which is rrhp still implies that Y » is 
rrhp, it is not simple to solve for YY, in such a way that Y ye” is 
also rrhp. Thus division by Y > is no longer useful. 

To obtain an alternative derivation of (52), use the Y», of (50) in 
(61). Then 


(A + Be 7”)(N + 8) — eS = U + Ve-"”, 


U is rlhp, (63) 
V is rrhp. 
Equate, separately, the terms which do and do not involve e’”, and 
cancel the rrhp factor e °” from those that do. Then 
A(N + 8S) — e*?S = U, which is rlhp, 
(64) 


BIN + 8) = V, which is rrhp. 


These equations correspond exactly to conditions c and d of (52). 
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3.3.4 A Somewhat More General Method 


In some problems (59) must be replaced by a slightly more general 
expression. In particular, s(7 + a), the last term in the square brackets, 
sometimes must be replaced by a more general function of 7, say K,(r). 
This is characteristic of problems involving linear constraints, which 
will be discussed further in Section IV. The methods described above 
may be modified in such a way that the transform of K ¢(r) need not be 
rational, provided ®, still corresponds to a rational spectrum. 

Suppose Y x is to be determined from conditions of the following sort 
(in which Yy,, Ay, F, Yc are of course the transforms of Ky, Ax, ®r , 
K c) : 


T 
a. | (Kulr) * &¢(r) — Kols)]Ax(x) dr = 05 
0 
b. K x(t), Ax(t) = 0 except when0 <t < T 
[then Ya, , Ay belong to the classes (47), (48)]; 
c. | Ya | = Ow”, when w is real and > ©; (65) 


d. y(t) = an auto-covariance function, 
F = Yr(p)Yr(p) = a rational function; 


e. K-(t) = a given time function, Y ¢(p) need not be rational. 


Let a new time function K(é) with transform Yc(p) be defined as 
follows: 


A 


Ke 


I 


K-(t) when 0<t<T, 


(66) 
= 0 when ¢t<QOor>T. 
Then, exactly as with Ys, we must have 
Yo(p) and Yet? are rrhp and rfpp. (67) 


In these terms (65) implies the following, replacing our previous (60): 
Kr) * ®p(r) — Ke(r) = Ko(r) + Ky(t — 7), 
Kvu(r) = 0 when 7> 0, ~ (68) 
Ky(r) = 0 when 7 <0. 


The functions Ky and Ky are like Ky and Ky of (60), except that they 
include the ‘tails’ of K¢ lying outside the interval 0 < 7 < T. 
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Now take the transforms of all functions in (68), and solve for Y s(p). 
If U and V are the transforms of Ky and Ky, the result is 
YotOU+Ve™ 
Yu = ——— fo 3 


a. U is rlhp, (69) 
b. V is rrhp, 
c. | Ya F = Ow ’ when wis real and > «. 


The functions U and V must be such that Ys is rfpp. But Y¢ itself is 
rfpp. As a result, 


a. The finite poles of U = the rhp poles of F; 
b. The finite poles of V = the lhp poles of F; 


c. If p = p, ata finite zero of F, (70) 
Y o(pr) i OU (px) + V(piye "7 = 0; 


d. When w is real and > «, U and V must behave 
in such a way that | Ya PF = Ow”. 


These conditions determine a unique rational U and V when F is 
rational, provided K-(é) satisfies certain requirements relating to 
continuity. If F > Cw” as w > o, then K(t) and its first m — 1 
derivatives must be continuous in the interval 0 < ¢ < 7. When the 
continuity condition is violated, there will be no Y » which meets all the 
conditions (65), unless (65c) is modified. (See Section 4.3 for an inter- 
pretation in connection with a particular application.) 

The transform Y¢(p) of Kc(t) need not be rational. Furthermore, 
when K¢(é) is given the time function can be calculated without actu- 
ally evaluating Y¢(p), except at the special points p = p, . In particu- 
lar, the following two relations may be used in evaluating the inverse 
transform of the right hand side of (69), with help of (70): 


B 1 . iets 
a. Yc(pr) = val Ke(r)e pk dr; 


Y ae 
b. Inverse transform of a = val Ker) Kam (t — 7) dr, (71) 


where Kayr)(t) = inverse transform of 1/F. 
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3.4 Simultaneous Optimization of Two Network Functions 


In each of our problems so far we have been required to find a single 
frequency function, Y y(p), which is to represent the optimum choice 
of a single linear operator, Y¢(p). There are other problems, however, 
in which two or more frequency functions are to be found, corresponding 
to the simultaneously optimum choices of two or more different but 
related linear operators. This section develops general methods in terms 
of one such problem. 

Suppose the same signal can be observed in two different ways, or at 
two different places, involving contamination with noise from two 
different (uncorrelated) sources. An important example which will be 
discussed later (but not the only example) is the observation of a single 
physical variable with instruments of two different kinds. There are now 
two observed time functions, fi(£) and fo(¢), related to, s(¢) by 


fi@® = s@) + md), 
a(t) = s@) + m(?). 

The two different time functions are to be modified by (different) 
linear operations, and the results are to be added, to obtain an optimum 
estimate of s(t + a). All the assumptions of Section 2.2 are to be retained. 
Thus, Gaussian ensembles may be substituted for s(é), m(¢) and ne(t), 
and Fig. 2 may be replaced by Fig. 12. 


From Fig. 12, the following integral is easily obtained, in place of 
(19): 


(72) 


+00 . 
¢ = [ (| Yea)? Mi + | Yee) Ne + | Yo + Yeo — e*” |? S) dw. (73) 








WHITE NOISE 
SOURCE NO.{ 


eee ariel 


| 

( 

I 

| 

| 

| 

| 

| 

| 

| 

| 

| 

WHITE NOISE 
SOURCE NO.2 
| 
| 
| 
| 
| 
\ 
! 
{ 
! 
! 


WHITE NOISE 
SOURCE NO.3 





| 
| 
| 
| 
| 
| 
| 
l 
| 
! 
1 
! 
! 
! 
| 
! 


Fig. 12 — A physical model for a signal which is observed in two different ways. 
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Here N; and N; are, of course, the power spectra of the two noise ensem- 
bles (assumed to be uncorrelated). Let Yan and Ya be the optimum 
choices of VY, and Y¢, and define Ay; and Ay by 


Ya = Y wn + Ay ); 


(74) 
Y G2 aad Y a2 rf Aye. 
Then (73) may be replaced by 
+00 
a= [Yul Ma+ | Yan Not | Yaa + Yue — 6% |S) dos 
$0 : 
+ [ (| Ava |? Ma + | Ave |? No + | dvi + Aye |? 8) dw ae 


-foo 
49 [ ([Yan(N; + 8) + YuoS — e”Slin 


+ [YaaS + Van(N2 + 8) — e°?S]Ay2} dw. 


The first integral in (75) is o,, corresponding to a Ay; and Ay2 which 
are zero identically. The second integral is positive for any Ay: and 
Aye which are not zero identically. Then, if Ay; and Ay: each obeys (29), 
the last integral must be zero. This replaces (23) by the following: 


For every permitted Ay; and Aye: 


+i 
[sna + 8) + YuoS — 6°*Slir (76) 


+ [YanS + Yinl(Ne i S) = e*? Slavs} dp = 0. 


The one integral can often be split into two, each involving one Ay , 
and each equal to zero. The separation may not be permissible however, 
when N,/S = Ow” at w = ©. An examination of convergence rules, 
noted below, will clarify this statement. Convergence conditions may 
again be obtained, by excluding at once, all Y.’s and Ay’s for which 
o = oc. Conditions are easily derived from the first two integrals in 
(75). These may be combined to obtain a condition on the integrand in 
(76). The result is 


When w is real and > ~, the following seven functions = Ow”: 
| Yan PN, | Varo Pe, | Yan + Yarn — e*? |S, 
|AnlNi, [Ave |'N2, | Av + Ave |*S, 
and the integrand in (76). 


(77) 
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Note that | Ay: |’S and | Ays /?S do not necessarily = Ow’, provided 
they are restricted by a linear relation at w— «.* 


3.4.1 Optimum Physical Networks When a 2 0 


Suppose Y a, and Y sp are to be selected from the class of all ‘‘physical”’ 
frequency functions, that is, from the Cy of (33). Then Ay: and Aye 
belong to the C4 of (34). Following our usual procedure, we fit the inte- 
grand of (76) to H(p) of (12). Behavior at © is already proper, and 
Ay, and Ay: are both rlhp. Then we have only to make the two associated 
factors also rlhp. Assembling these requirements with conditions of 
physicalness and convergence gives: 


a. Youn is rrhp, 
b. Vare is rrhp, 
ce. Yan(Ni + S) + YanS — e°?S is rlhp, (78) 
d. YinS + Yar(Ne + S) — eS is rlhp, 
e. When w is real and > ~, the following three functions = 
Ow”: 
| Yan we ) | Yar Ne ) | Yon + Yar — e°” ’S. 


When a = 0, Yan and Yy2 are rational (assuming rational NV, , Nz, 8), 
It is not at once apparent, however, what the poles of Y 4 and Y se wil 
be. From (78c) and (78d), we can define two rlhp functions, say U; and 
UO. ) by: 


Yiun(Ni + S) + YanS — eS = ti, 


x ‘ (79) 
YanS -+- Y wo(Ne + S) = E ?S = U2. 
Solving for Yan and Y x gives: 
Y a ON. fe (O; = U2)S + e°?SNo 
7 NiwN2 + (Ni + N2)S : (30) 
y fe UN1 = (Ti a U2)S + e°? SM, 
M07" OC,,.""™i;, aT 1. SAT? |b "7, \ OY Oe 


NiN2 + (Ni + N2)S 
Since Yan and Y ye are to be rrhp, while 0, and Uy are to be rlhp, the 
2 


* For example, suppose Ni, N2 = Ow-t as w > ©, and S = Ow™*. Then | Ay: | 
and | Ay2 |? may = Ow*?, provided Ay: and Ay: are so related that | Ay: + Aye |? = 
OC. But this Ay; and Ay2 cannot be chosen entirely independently, and then the 
integral in (76) must not be split in two. 
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two pairs of functions can have no finite poles in common. Then every 
finite pole of Yan or Y x2 in (78) must belong to one or the other of the 
following classes: 


a. The lhp zeros of NyN2 + (Ni + N2)S; 


b. For Yan, any lhp poles of Ne or S which are not poles of 
N,N2 + (Ni + N2)S; for Yue, any lhp poles of N, or S 
which are not poles of NiN2 + (Ni + N2)S. 


(81) 


The second class occurs only in special or degenerate cases, such as 
when zeros of Ni + Ne happen to coincide with poles of S. 

After the permissible poles have been determined by (81), (78) may 
be used to find the numerators of Yan and Ya. Simultaneous linear 
equations in the numerator coefficients may be derived from required 
behavior at lhp poles of S, N;, Ne and also at poles of Yarn and Yao 
themselves. For the latter, take the difference of (78c) and (78d) to 
get: 


(Yan; ao Y y2N2) is rlhp. (82) 


Numerators of the minimum degree are determined uniquely, and also 
turn out to be just compatible with (78e). In special or degenerate cases, 
certain of the poles, permitted by (81), may coincide with zeros of the 
corresponding numerators of Vy, and Ys and can be cancelled out. 


3.4.2 Optimum Physical Networks When a < 0 


When a = —8, with 8 > 0, Sections 3.2.2 and 3.4.1 may be combined 
to get 


_ SNoe P? 
Yun = Ar + NiNe bt (Nv NDS (Nie NDS? 
SNe *? ee 
Yur = Ag + ie 


NiN2 + (Ni + N2)S° 


Here, A; and A: are two different rational functions, not necessarily 
trhp (even though adding the exponential terms must make Yan, 
Y we rrhp). Substituting in (78) and using a generalization of (32) gives* 





* Paralleling Section 3.1 gives, in place of (82): 
NNS 
NiN2 + (Ni + N2)S 


= Ow? asw > 0 
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SNe °? é 
A ————— ; 
@, Ai-F Nae + (WOE Nos 8 rrhp, 
SNe °? 
Tg 
b. Ao + Na an Twos is rrhp, 
c. Ay(Ni + S) + AS is rlhp, (84) 
d. AyS + A2(Ne2 + S) is rlhp, 


e. When wis real and > , the following three functions = Ow ”: 


|.4i Ni, |As|’Ne, | Ar + Ao|’S. 


In (84), conditions a and b put the rhp poles of A; and Ag at the rhp 
poles of the functions which multiply ¢ °’. Conditions ¢ and d permit 
the same lhp poles as the poles of Yan and Yap for a > 0, which are 
determined by (81). Combining the lhp and rhp conditions shows that 
every finite pole of Ai or Az must belong to one or the other of the fol- 
lowing classes: 


a. The zeros of NyN2 + (Ni + N2)S; 


b. For Yan , any poles of Nz or S which are not poles of NiN2 + 
(Ni + Ne)S; for Ya, any poles of Ni or S which are not 
poles of NiN2 + (Ni + N2)S. 


(85) 


These are merely the extensions of the classes (81), to include poles 
in both half planes. 

The poles of A; and Az are twice as numerous as the poles of Yarn 
and Y x2 for a > 0. Asa result there are more numerator coefficients to 
be determined, but they are still determined by simultaneous linear 
equations. 


3.4.3 A Time-Domain Interpretation 


Paralleling Section 3.2.3 gives a time-domain interpretation. Although 
it does not represent a significant simplification of the present problem, 
it does have theoretical interest, and also a potential usefulness in varia- 
tions of the present problem. 

In Section 3.2.3, we multiplied the rlhp function in (85b) by the rlhp 
function 1/Y,, so as to obtain the rlhp function (44), in which the 
rrhp term Y »,Yr may be regarded as the only unknown. We now multiply 
the two rlhp functions in (78) by two different rlhp functions and add 
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the result. The object is to obtain an rlhp function with a single unknown 
term which is itself rrhp. 

Let Qi and Q» be two (as yet unknown) functions of p, both required 
to be rrhp. Then Q, and @ are both rlhp. If we multiply the two rlhp 
functions in (78c) and (78d) by Q, and Q, and add the result the sum 
will have to be rlhp. The sum can be written as follows: 


(YanYa + YanYs) — e*?S(Q, + Q2) is rlhp, 
Ya = Q(N1 + S) + QS, (86) 
Y, = QS ze Q2(N2 ae 8). 


If Y, and Y, are both rrhp, as well as Yan and Yar, the function 
(YanYa + Yar¥o) will be rrhp and can be found from (86) by the 
Bode-Shannon method. This function can be used to express (82) in 
terms of Yan or Y 42 alone. Thus, Yan and Y x2 may be found by a se- 
quence of straightforward calculations, as soon as Q, and Q2 are known. 
The problem is to find a Q; and a Q2 such that Y, and Y» are, in fact, 
rrhp. It may be more informative to use the equivalent requirement 
that Y, and Ys must be rlhp. Then (since N,, Nz, S are even), (86) 
requires 


a. Ya = QANi + 8) + Q2S is rlhp, 
b. Ys = QS + Q.(N2 + 8) is rlhp, (87) 
c. 1, Qe are rrhp. 


Equations (87) are about as hard to solve for Q; and Qe as (78) is for 
Youn and Y y2. The poles of Q; and Qe are exactly the poles of Yan and 
Y yo. The numerators are different and are not uniquely determined. 

Note that the calculation of Q: and Q. does not involve the terms 
e°?S of (78). These enter only in the Bode-Shannon type of analysis. 
The method has potential usefulness in variations of the present prob- 
lem, in which the terms e*”S are replaced by more complicated functions. 
(Compare this section with Section 3.3.4). 


3.5 Sampled-Data Systems 


This section shows how the methods which we applied in the previ- 
ous sections to continuous-data systems may be modified for application 
to discrete, or sampled-data systems. Methods appropriate for discrete 
systems can, of course, be derived without reference to continuous-data 
systems; and they have been so derived by, for example, Levinson (Ref. 
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1, Appendix B), and Lloyd and McMillan.” It is interesting to observe, 
however, how simply the transformation may be accomplished, from 
techniques for continuous-data systems to techniques for discrete-data 
systems. For this purpose, it will be sufficient to outline an appropriate 
procedure, without filling in details. 

Two different kinds of discrete-data systems may be considered. The 
signal and noise may be discrete time series, described by statistics 
appropriate for such series. On the other hand, the signal, s(¢), and the 
noise, n(t), may themselves be continuous time series, with the obser-— 
vations of signal-plus-noise, f(é), limited to discrete ‘‘sampling’’ times. 
Methods appropriate for both kinds of discrete-data systems may be 
derived from a study of continuous-data systems of a special kind. 


3.5.1 A Special Kind of Continuous-Data System 


Yollowing the usual methods of ‘“z transform’ theory, let z = e ”?, 


in which T is to be the sampling interval. Rational functions of z, when 
treated as functions p, now have inverse transforms which are zero 
except at the discrete times oJ’. The methods which we have applied to 
continuous-data systems do not apply directly to spectra, S and N, 
which are simply rational functions of z. The behavior at p = © leads 
to divergent integrals such as, for example, the integral in (81). On the 
other hand, spectra of the sort described below meet the convergence 
conditions and also lead to Y x(p) which are exactly rational functions 
of z. Then the only data which are actually utilized are the data observed 
at the discrete times ¢ — oT’. 

Note that 2 = 1/z, and that |z| > 1 in the left half of the p plane. 
Use the notation Y(p) = Y,(z) and Y,(z) = Y,(1/z). In these terms, NV 
and S are to be 


q 
a S= rag Ys¥s, 
qd ~ 
b. N= yaaa tele: (88) 


c. Ys,(2), Ywe(2) are rational in z, 
d. Ys:, Ynez, 1/Ys, 1/Ym. are regular at |z| < 1. 
The constants q and ¢ are to be real and positive. 
Suppose a > 0, in s(t + a), and Yy is to be the optimum “physical” 


Ye, when N and S are described by (88). The procedure explained in 
Section 3.2 is easily adapted to the new problem. Corresponding to 
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(85), one gets: 





a. Yx(p) is rrhp, 
q . 
b. T— &p Y3(p) 1S rlhp 
- (89) 
Yy,= Vu Vaal az + YVy.¥ ve) = se ’ 


Co VY se |< 8 ah 


These conditions are satisfied by a Ya(p) such that Yy.(z) is rational 
and meets the following conditions: 


a. Ys2(z) is regular when | 2| < 1, 
b. Y»z,(z) is regular when | z| > 1, 

; 7 (90) 
c. Yx,(z) = 0 when 1 + ep = 0, 


d.0<|Ysx.(z)| < © atz= o, 


The factor g/1 + ¢w was applied to N and S in (88) to obtain con- 
vergence of integrals in the derivation of (89) and (90). However, we 
can make ¢ as small as we wish, and Y x approaches a reasonable limit 
as e— 0. The poles of Y x, are completely independent of e«. The numera- 
tor approaches a limit such that condition (90c) disappears, and (90d) 
changes to 


Y3(z) = 0 at z= ©. (91) 


This follows from the fact that (90c) requires Ys, to have a numerator 
factor in z which is zero at the zero of 1 + ep — namely, a factor 


7 e Tl), = e (ro dten) (92) 


When ¢ is small, but not zero, the autocovariances corresponding to 
the N and S of (88) take the form shown in Fig. 18. The “‘spikes’’ become 
sharper as e becomes smaller. As ¢ — 0, the integrals of the N and S 
of (88) become infinite unless g also — 0 to order of ¢. The function Y x , 
however, is entirely independent of g, which need be considered quanti- 
tatively only in calculating the corresponding variance, oy. 


3.5.2 Discrete Time Series 


Suppose S and WN are the spectra of continuous time series s(é) and 
n(t), such that the covariances are exactly zero except when the lag 
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Fig. 13 — A special form of auto-covariance function. 


time is o7’, with o an integer. Let the prediction time a also be an inte- 
gral multiple of 7. The corresponding Y x, will be such that the estimate 
g(t), of s(t + a), will depend only on the values assumed by s(t), and 
n(t) at the discrete series of times t — oT’. Since the values of s(t) and n(t) 
which occur at intermediate times are not utilized, and are not corre- 
lated to the values which are utilized, they can have no significant re- 
lation to the problem; they may be regarded as undefined without al- 
tering the solution. Thus the special continuous-data system yields the 
same Y y as though s(¢) and n(¢) were discrete, ordered sequences of ran- 
dom variables matching the values which are assumed by the con- 
tinuous time series at the discrete times o7’. 

Conversely, when s and n are initially discrete series, corresponding 
continuous ensembles may be constructed for calculating the optimum 
smoothing and prediction. When the covariances of the discrete series 
are sums of exponentials in mz — m,, where m, and mz are the order 
numbers of the samples involved, the corresponding S and N will be 
rational functions of z = e *”, and Yy and Ky may be found by apply- 
ing Section 3.5.1. Many details, of course, remain to be filled in. 


3.5.3 Discrete Samples of Continuous Time Series 


Now suppose that s(f) and n(t) are continuous time series with ra- 
tional spectra S and N, but that f(é) = s(¢) + n(d) may be observed only 
at discrete ‘sampling times’’, = o7’. Let “present time”’ ¢ coincide with 
one of the sampling times and consider the calculation of the optimum 
Y wu for estimating s(t + a), with a > 0. 

In Section 3.2.4, we replaced the Gaussian statistical model shown 
in Fig. 6 by that shown in Fig. 8, which has the same pertinent statisti- 
cal characteristics. Now, the pertinent statistics are even more restricted, 
and a further change in the Gaussian model is useful. In particular, the 
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frequency functions Yr, Yrs and the single random quantity v; may be 
modified in any way which leaves the following covariances unchanged 
(in which o is a nonnegative integer): the auto-covariance of f(t) at the 
discrete lag times o7’, the cross-covariance of f(é) and s(¢) at the discrete 
lag times (a + o7') and the auto-covariance of s(é) at the lag time zero. 

Our present problem may be solved by changing Yr, Yrs, Ns (with- 
out changing the pertinent statistics), in such a way that the optimum 
Yu(p), computed on a continuous-data basis, will be the transform of 
a K y(t) which is zero except when t = oT’. The output of a correspond- 
ing device, at any sampling time, will depend only on the values of the 
input at sampling times. A suitable mechanization for the sampled-data 
system, derived from this Yy or Ky, may be either a fixed network 
(or equivalent device) with sampling at input or output, or digital com- 
putations carried out once each computing cycle. 

When WN and S are rational functions of frequency, Yr and Yrs may 
be changed to rational functions of z, and Section 3.5.1 may be applied 
to find Y 4 as a rational function of z. When a = m7’, with m an integer, 
it is sufficient to change N and S to suitable rational functions of z, 
preserving auto-covariances of s(¢) and n(é) at lag times o7’, and then to 
apply Section 3.5.1. When a # mT, however, Yrs must be modified 
further (or the related function Se*”). As in the previous section, many 
details remain to be filled in. 


3.6 Nonstationary Systems 


In this section, we consider signal and noise ensembles which are 
statistically nonstationary. Some years ago, Booton” described integral 
equations which determine the corresponding linear least-squares 
smoothing and prediction operators. The general integral equations, 
however, are very much more difficult to solve than are the equations 
corresponding to stationary systems. On the other hand, the techniques 
described above, for stationary systems, may be paralleled, in principle 
at least, for analogous nonstationary systems. More specifically, a one- 
to-one correspondence may be established between the individual rela- 
tionships and operations used in the techniques and a new set of relation- 
ships and operations which are appropriate for at least a large class of 
nonstationary systems. 

While it is clear that the new relationships and operations are appro- 
priate for many nonstationary systems, the exact range of their appli- 
cability has not been fully established. In addition, the manipulations 
required in numerical problems are very much more complicated than 
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the stationary counterparts and they may be feasible only for quite sim- 
ple systems, even when electronic computers are available. Accordingly, 
a very brief outline may be sufficient here, leaving a fuller exposition 
for a later paper. 


3.6.1 A Class of Nonstationary Systems 


In previous sections, we considered finite networks of lumped elements, 
driven by white noise, as physical models which generate stationary 
Gaussian ensembles with rational spectra (Figs. 2, 3, 6 of Section II 
and Fig. 8 of Section 3.2.4). We now change the picture only by permit- 
ting the network components to be time variable; we thereby define a 
class of nonstationary Gaussian ensembles, analogous to the stationary 
ensembles which have rational spectra. Miller and Zadeh” have studied 
essentially the same class of nonstationary ensembles, in somewhat dif- 
ferent terms. 

Let V be the input and & the output of a finite network of lumped, 
linear, time-variable elements. Then 


PV = QE, 


ag aS ead 


e Fi din’? (93) 


Q 


ll 


H+ G+ +E). 
The coefficients a, , b,, H are now generally time-variable. 

Consider the functions U, , defined by PU, = 0, and the functions 
L, , defined by QU, = 0. There will always exist n linearly independent 
U,’s and m linearly independent L,’s. The U,’s may be referred to as 
the basis functions, or bf’s, and the L,’s as the zero-response functions, 
or zrf’s. In the theory of nonstationary systems, the bf’s correspond to 
the poles of the admittances of stationary systems, and the zrf’s corre- 
spond to the zeros. In general, the bf’s and the zrf’s may be chosen in 
any of various ways, since linear transformations of legitimate choices 
are also legitimate choices. Frequently, however, a specific choice is 
particularly useful, as in the situation described below. 

Existence theorems are more easily established if the coefficients a, , 
b, , H in P and Q, when viewed as functions of time #, are required to be 
analytic at £ = — oo. Then, except in degenerate cases which need not 
be considered here, the bf’s, U, , and the zrf’s, L, , may be so chosen that 
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they behave as follows, in accordance with Bellman:” 
a. When a, , 0,, H are analytic at t > —o, 
b. Then U, > t” ce?‘ and L, > €°"e?""*, 


The coefficients y, and p, are constants. The p,’s may be described fur- 
ther in terms of P and Q of (93). Let P,,(p) and Q,,(p) be the polynomials 
derived from P and Q in the following way: Replace d/dt by p. For co- 
efficients, use the values assumed by the a,’s and },’s at = — «©. Then 
the p,’s are the zeros of P,,(p) and the p,’’s are the zeros of Q,,(p). The 
same sort of conditions for ‘physical’? networks may now be applied to 
the p,”’s and p,”’s as to the poles and zeros of stationary admittances. 
(The coefficients must also behave “reasonably” in some sense, although 
not necessarily analytically, at times other than t > — .) 

When the p,’’s have negative real parts, as required for “physical” 
networks, the integration of (93) gives (for m < n): 


(94) 


‘ + 
VO [ K(t, r)E(z) dr, 


ROS Ss LOCO: Wiens eee: (95) 
o=1 


= 0 when + > bt. 


Here, K is the impulse response, as in previous sections, but it is no 
longer a function of the single variable ¢ — r. The U,’s are again the bf’s 
of the differential equation (93) and the X,’s are new functions. Their 
calculation is at least straightforward, provided the U,’s are known, as 
well as the coefficients of Q in the differential equation. The X,’s are 
roughly analogous to the residues at the poles of the transfer admittance 
of a stationary network. (The functions X,/U, are a closer analog.) 


3.6.2 Manipulations of Differential Equations 


When a time-variable network is made up of networks in tandem or 
networks in parallel the differential equation for the complete network 
may be found from the differential equations which correspond to the 
different parts. The processes are analogous to, but not the same as, the 
algebraic products and sums which are used to combine the rational 
admittance functions of stationary partial networks. The differences 
may be said to stem from the noncommutability of time-variable coeffi- 
cients and the derivative operator, d/df. 


(c sf VF 3 CV, when C is time-variable. 
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Conversely, differential equations such as (93) may be decomposed 
into sets of simpler differential equations, corresponding to partial net- 
works connected either in tandem or parallel fashion. For this, however, 
one needs to know the bf’s of the differential equation (and also the 
zrf’s, for tandem circuit decompositions), just as one needs to know the 
poles (and also the zeros, for tandem circuit decompositions) when de- 
composing the admittances of stationary circuits. The operations are of 
course analogous to, but not the same as, the factoring and partial frac- 
tion expansion of admittance functions. 

Manipulations of the sort noted above are mescrpee in more detail 
in a previous paper by the author.” 


3.6.3 Aulo-Covariances 


When the input signal V is (unit level) white noise, the auto-covari- 
ance, ®, of the output signal, /, may be calculated from the impulse 
response, J. When K is as in (95b), may be expressed as a somewhat 
similar finite sum. More specifically, 


oo 
a. P(t 3 t1) => K(t ) r)K(t ? r) dr, 


b. P(t, t) = > Ue(t)Welh) when 4 <b (96) 
o=1 


=>) WAt)U(h) when & > bh. 
o=1 


The U,’s are again the basis functions or bf’s of the differential equa- 
tion (93). The W,’s are new functions, which may be calculated in any 
of various ways. , 

A differential equation, corresponding to ®, may be defined as the 
equation connecting two time functions, say G; and G2, in such a way 
that 


-foo 
Ge (te) = [. ® (te, th) Gi (t;) dt, . 


The differential equation is of order 2n. Its bf’s comprise both the U,’s 
and W,’s of (96), but its zrf’s can be found only by solving a homogene- 
ous differential equation with time-variable coefficients. 

‘In (96a), K(t:, 7) may be replaced by K*(r, 4), where K* is the 
“adjoint” of K, defined as the function obtained from K(t, 7) by inter- 
changing, within the function, the input time, 7, and the output time, ¢. 
The integral of the product K(é , 7)K°(r, t:) is a convolution, represent- 
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ing the impulse response of the tandem combination of two networks. 
The two networks are the original network preceded by a (nonphysical) 
network with the adjoint response, as in Fig. 14. 

We may now relate G; and G2 through an intermediate variable, say 
Gm, by means of 


a. P°Gn = Q'G; ) 


97 
b. PG, = OGn. ( ) 


Here, P and Q are as in (93), and P* and Q* are similar operators, which 
lead to the adjoint K°(t, 7) of the impulse response K(t, r). 

When systems are stationary, the transform of ® is the product 
Y(p)Y(p). When systems are nonstationary, the bf’s and zrf’s of (97a) 
are analogous to the poles and zeros of Y(p), just as the bf’s and zrf’s 
of (97b) are analogous to the poles and zeros of Y(p). The simple product 
of Y and Y¥ is replaced by the construction of a single differential equa- 
tion, from the two equations of (97), through the elimination of the 
intermediate variable G,. One half of the bf’s of ® are exactly the 
bf’s of K, and one half of the zrf’s of @ are the arf’s of K*. The other 
halves of both the bf’s and zrf’s of ® are not exactly the bf’s of K* and 
the zrf’s of K, except when systems are stationary. 

The function ®(é , 4) is symmetrical in f, and 4. As a result, ® is its 
own adjoint. The self-adjoint property of @(f2, t:) corresponds to the 
evenness of the frequency function Y(p)Y(p), which was noted in the 
analysis of stationary systems. 

When (uncorrelated) signal and noise ensembles each have auto- 
covariances of the general form (96), the auto-covariance of the signal- 
plus-noise is Ps + &y , and it has the same general form. The U,’s and 
W,’s of &y simply comprise all the U,’s and W,’s of ®s and ®y . 


3.6.4. An Analog of the Bode-Shannon Method 


Now consider the calculation of linear least-squares smoothing and 
prediction operators when auto-covariances, ®s and ®y , of signal and 


Gilty) Ga(tz) 


Ka(nt) oH K(t,7) 


Cnt?) Sf Ki Gate ttidt, elt) =/ Kits PIGal ride 


Fig. 14 — A (nonphysical) network whose impulse response is ®(f2 , ti). 
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noise are known, have the form (96b) and satisfy condition (94a). The 
method described below is analogous to the method of Bode and Shan- 
non, as interpreted in Section 3.2.4. 

We begin with the physical model illustrated in Fig. 15, which is 
exactly like Fig. 8, of Section 3.2.4, except that the (now nonstationary) 
impulse responses of the networks have the form K(é, 7), instead of 
K(t — 1) [the inverse transform of Y(p)]. The method described in Sec- 
tion 3.2.4 can be adapted to the model of Fig. 15, in principle at least, 
provided an impulse response Kr(t, 7) of the form (96b) does, in fact, 
exist which has the following properties: it must turn white noise into 
an f(t) = s(é) + n(é) with the required auto-covariance, @r(fe, t); it 
must be “‘physical’’; there must exist a “physical”? impulse response, 
Ky ‘(t, r), which turns f() back into the white noise. 

The manipulations described in Section 3.6.2 may be used to decom- 
pose the differential equation corresponding to ®y into a pair of differ- 
ential equations which are at least superficially like (97a) and (97D). 
Under condition (94a), a particular decomposition will always have the 
following properties: the orders of the two equations are the same; the 
two equations have identical coefficients H of (93); the bf’s and arf’s of 
(97a) are all ‘‘nonphysical’’, while those of (97b) are all “physical” [as 
determined by the real parts of the p,’s of (94b)]; the corresponding im- 
pulses will be respectively Kr’ and Kr provided they are, in fact, ad- 
joints, each of the other. 

While a rigorous proof has not been completed, there is strong evidence 
that the two impulse responses will, in fact, be adjoints when derived in 
the manner described from auto-covariances of the form (96b) subject to 
the condition (94a). The same probably holds true in many situations 
where (94a) is not satisfied. When (97a) and (97b) have been determined, 
Ky" may also be found, by merely interchanging P and Q in (97b) and 


Vs s(t+ a) 





WHITE NOISE 
SOURCE 





Fig. 15 — A physical model of a nonstationary system. 


LINEAR LEAST SQUARES SMOOTHING AND PREDICTION 1273 


then calculating the corresponding impulse response. It will be physical 
because the zrf’s of K have been made physical. 

For the most part, the calculations described above are straightfor- 
ward but laborious. The bf’s of the differential equation for ®y are the 
basis functions U, and W, of ®s and @y , and are known when ®z and ®y 
are known in the form (96b). The zrf’s of @r , however, must be calculated 
as solutions of a homogeneous linear differential equation with time-vari- 
able coefficients. This is analogous to finding the zeros of the spectrum 
N + S when given rational spectra N and S. The computational diffi- 
culties, however, are very much greater, and they are likely to limit ap- 
plications to quite simple problems. 


3.6.5 An Analog of the Zero and Pole Method 


Some of the laborious calculations (but not the calculation of zrf’s of 
@,;) may be avoided by techniques analogous to the zero and pole tech- 
niques described in Section 3.2, etc. For definiteness, let the optimum im- 
pulse response, K x(¢, r), be chosen from the class of all stationary and 
nonstationary physical impulse responses (infinite memories included) 
and let the prediction interval a be greater than 0. Methods similar to 
those used in Sections 2.6 and 3.2.3 yield a Wiener-Hopf equation of the 
following sort [a generalization of (45)]: 


t 
i EGG G Se PO GSE (98) 
When #7 = ®s + by, and ®s, @y have the form (96), (98) becomes: 


Dy U.(t2) [ Kut, Woh) dts 
° Om a =P WUE +e) =f. (9) 
+ > Wt) f Kult, ty) U.(t1) a 


The sum }/, includes those terms in >>, which are contributed by ®s , 
but not those from ®y . 

A differential equation may be derived from (99) which is exactly the 
differential equation corresponding to ; , with K x, taking the role of the . 
‘Input’ function, Gi(t), and the right-hand side of (99) taking the role 
of the “output” function Ge(t). Time ¢ is a constant in the derivation and 
analysis of this differential equation. Then G2(fz) is a sum of some of the 
bf’s of the differential equation. As a result, K 4 must be a linear combina- 
tion of zrf’s of y , except that 6 functions may be permitted at the limit 
of the integration, 4, = ¢. More exactly, K y is a linear. combination of the 
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physical zarf’s of ®r , plus possible 6 functions. This is analogous to con- 
dition (36a) of Section 3.2.1, which makes the poles of Y y the lhp zeros 
of N + 8. 

The coefficients of the various terms in the linear combination may be 
_ determined by using the linear combination with general coefficients, in 
place of K y in (99). Evaluating the integrals yields a linear combination 
of the U,’s, which are the physical bf’s of ; . Since the combination must 
be identically zero [when the right-hand side of (99) is included], the net 
coefficient of each U, must be zero. The result is a set of linear equations 
which determine the coefficients of the various terms in Ky . The equa- 
tions are analogous to the conditions (36b) on the behavior of Ya, at 
lhp poles of N and S. 


IV. FURTHER SPECIFIC PROBLEMS AND APPLICATIONS 


The central problems described in Section III may be adjusted to fit 
various engineering problems. The adjustments, however, may require 
changes in various details. The examples described in this section illus- 
trate both engineering usefulness and ways in which details may be 
changed. Some of the examples represent existing engineering applica- 
tions. Some are merely potentially useful. Others are of interest primarily 
for theoretical reasons. The specific changes in the central problems are 
reviewed in more general terms in Section 4.6. 


4.1 Problems Related to Anti-Aircraft Fire Control 


The correct aiming of anti-aircraft artillery depends, fundamentally, 
on data smoothing and prediction. It also illustrates several of the ways 
in which the central problems may be modified to meet practical require- 
ments. The anti-aircraft problem, as such, will not be developed in more 
detail than is needed for purposes of illustration. 

An anti-aircraft projectile must be aimed at a predicted future position 
of the target, for which the prediction is based on positions of the target 
observed at present and past times. The observations (optical or radar) 
are contaminated by fluctuating observational errors, corresponding to 
some statistical ensemble. The true motion of the target also corresponds 
to a statistical ensemble, for the direction of flight and the speed will 
change with time, in ways which are not entirely predictable. Then the 
observational errors correspond to our noise, n(t), and the true position 
of the target corresponds to our true signal, s(¢). While the problem is 
really three-dimensional, it will be sufficient for our purposes to consider 
a single one-dimensional component. 


LINEAR LEAST SQUARES SMOOTHING AND PREDICTION 1275 


It is generally reasonable to use a Gaussian model for the observational 
errors. The observations, however, are likely to be available only for a 
limited interval. Thus the finite-memory form of the general problem 
should be assumed. 

The true-signal (target) statistics are not well represented by a Gaus- 
sian model. Furthermore, the average square error is not a reasonable 
criterion of accuracy, without a careful interpretation. (The average 
square error gives most weight to large errors, while the “kill probability” 
depends on the frequency of small errors.) A somewhat nonoptimal solu- 
tion is generally accepted, as described below. 

Most anti-aircraft fire control systems are designed around the fol- 
lowing assumption: 


In the absence of observational errors, the future position of a 


nonaccelerating target is to be predicted perfectly. 100) 


A nonaccelerating target flies a straight-line, constant speed course. 
Under (100), the actual errors in prediction will depend on the actual 
observational errors and on the actual accelerations of the target during 
the combined observation and prediction intervals (¢ — T tot + a). 

The future position of a nonaccelerating target may be determined 
from its present position and present velocity. Hence, physical linear 
operators can satisfy (100). Generally, the truly optimum linear operator 
cannot be very different. Anti-aircraft systems must have a high per- 
centage accuracy. That is, position errors must be small compared with 
typical distances from tracker to target or from present target position 
to predicted future position. Furthermore, the signal ensemble may 
generally be regarded as centered about the nonaccelerating target 
courses. Therefore, the truly optimum linear operator must sum the ob- 
servations in a way which comes very close to giving perfect prediction 
under the special condition stated in (100). Then small changes will 
make these particular predictions perfect. 

Let x be any one component of position. Then 


a(t + a) = x(t) + at. (101) 


Here, £ is the average rate of change of x, averaged over the prediction 
interval, ¢ to ¢ + a. Under (100), separately optimum estimates of x(é) 
and #, used in (101), give the optimum estimate of x(¢ + a). (A proof is 
not needed for our present purposes.) In anti-aircraft systems, errors in 
x(t) are usually less significant than errors in az, and they are generally 
less subject to reduction by data smoothing. Then attention is centered 
on the optimum estimation of Z. 
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The optimum estimation of z is described in Sections 4.1.1 through 
4.1.4. In these sections, our signal, s(¢), becomes the true volocity <(). 
Instead of predicting #(¢ + a), we are to predict %, which is the average 
of z(t) over the interval t to t + @ (41s a functional of «). The prediction 
is to be obtained by linear operations applied to observed positions x(é). 
Since a factor p in a frequency function corresponds to differentiation, 
we may write 


g(t) = & + e(t) = x(t) modified by a linear operator Y¢(p)p. (102) 


Here, Y¢(p) represents the data smoothing applied to the apparent rate 
of change, f(t) = observed «(¢). The error part of f(¢) is described by the 
spectrum 


N = YwYn=oNz, (103) 


where N, is the error spectrum for x(é) itself. 


4.1.1 Optimum Measurement of a Constant Velocity* 

In this section we assume the following conditions: 
a. Positions x are observed from ¢ — T' tot, 
b. Conditions (100) are to be satisfied, (104) 
c. The true 2() is constant from ¢ — T tot + a. 


When condition (100) is satisfied and the actual <(¢) is constant, the en- 
tire error e(é) must be due to errors in observation. Then, by (103) and 
the noise part of (19) or of Fig. 2, 

+: 


g = il | Yoel? N.w dw. (105) 
When z(t) is constant, present <(¢) = %, and prediction time a need 
not appear at all. Then (104b) requires that Y¢(p) applied to a constant 


must yield the same constant. Since the response to a constant signal C 
is CY <(0), we now have 


Cy is the subclass of the class (47) such that Y¢(0) = 1. (106) 
If Ye;(0) = Ye(0) = 1, the difference Ay(0) = 0. Then 
C's is the subclass of the class (48) such that Ay(0) = 0. (107) 
Note that (107) is consistent with (29). 


* An early treatment of this problem, yielding solutions of special cases is 
included in a wartime report by Phillips and Weiss.?5 
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The optimum operator Y y, is now the Y g of the class (106) which mini- 
mizes o’ in (105). As in Section 3.3, use 


Y = Al + Be. 
ae (108) 
Yar, Yue” are rrhp. 


Equation (51) may now be adapted to the present problem as follows: 


Omit terms proportional to S. Replace N by N,w’, or, in terms of 
p = —w, by —N.p’. To take account of (107), rearrange the inte- 


grands, so that Ay/p becomes the variation factor rather than Ay [(107) 
excludes poles of Ay/p at p = OJ. This changes (51) into 


oe AY _ 
[. (AN .p’p) — ae +f" (BN .p'p)e 7m» AY 


dp =0. (109 
- (109) 


Section 3.8 may now be paralleled further, to assemble conditions 
corresponding to (52). Since there are no terms in e*” in (109), a rational 
N, leads to rational A and B. Then (52a) and (52b) may be replaced by 
(49). The resulting list of conditions is as follows: 


a. A+ Be’? = latp = 0, 

b. A + Be’? is rfpp, 

c. AN.p’ is rlhp, (110) 
d. BN.p’ is rrhp, 

e. When w is real and > , 

1A) Nw and|B/ Nw = Ow”. 


When JN, is rational, these conditions are just sufficient to determine a 
rational A and B. 
As an example, suppose JN, is* 


x = Put a = = a ao — pt’ (111) 

Then (110c), (110d) and (110e) restrict A and B to 
re a, + asp + asp pa ot bp + bsp’ 
a a ne 


* The scale factor has been designated in such a way that o,? is in fact the 
average squared position error which is related to N, by 


(112) 


foo 
2 = Nz dw 


—oO 
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Given (112), one can use (110a) through (110d) to find a, az, a3, bi, 
be , bs . The resulting Ys», may be arranged as‘follows: 


(+2)a — ep) ( -2)a + cp) 
Yu = —12J = 2 See , (113) 


in which the constants J, c are related to 7, wo, by 


T 2 
: -F(1+g), 
1 (114) 
ue 6 12 


To Tw? 


The corresponding impulse response K y(t) may be arranged as follows: 
K x(t) = JK,i(t) i (i aa J)K2(t), 


KO = pT) when 0<t<T, 
(115) 
Kt) = a when 0<i< T, 


Kit) = 0, Kt) = 0 when t <Oor> T. 


The two functions K, and Ky are the unit-area parabola and unit-area 
step shown in Figs. 16(a) and 16(b). Then K x is the combination shown 
in Fig. 16(c). 

The minimum o” determined by (105) may be found by evaluating 


“reo ‘ a a 4 
je i (A + Beo-™)(A + Be™)N 0? de. (116) 











— 


K5(t) —> 
4|- 
JK, (t) +(1-J) Ka(t) 











(a) PARABOLA (b) STEP (Cc) PARABOLA + STEP 


Fig. 16 — Parabolic smoothing. 
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The evaluation is complicated by the presence of the two exponentials 

in the integrand, and the multiple poles of A and B at p = 0, as deter- 

mined by (112). The complications may be resolved by splitting the in- 

tegral into the following two integrals: 
+ico 


a (4 + Bet? — 


I 4.00 


1 
1+ cp 


+ico AND _ | 
-[ . E T+ (Ae"* + B)BN.p | ap. 





) AN.p dp 
(117) 





Each integrand = Ow * when w is real and > ©; it is regular at p = 0 
[by (110a) and (110b)]; and it involves only a single exponential. The 
first integrand is rrhp; the second is rlhp except for a single pole of 


AN.p'/(1 + ep) at p = —. Closing the contours of integration by 
suitable arcs at ©, and applying the residue theorem gives 
2 24. On 
pe eesti 118 
Sone, (118) 


4.1.2 A White Noise Approximation 


The constant J in (113) and (114) is a function of Two. Generally, 
Tx is quite large. In the limit, as Tw» > ©, J — 1 and (118), (115) and 
(118) become 


7) ( 7) rp 
— —-—j+(1+— Je 
Y, = 12 ae) ol cues al 


Tp3 
119 
Ky = a t), (119) 
2 240, 129 
Cc = T? wo = Ts N,(0) 


The parabolic smoothing represented by (119) was derived by Bode” 
in a quite different way. 

Note that N.(0) is the spectral density of the position errors at low 

‘frequencies. The result, (119), may be obtained more simply by substi- 
tuting the constant N.(0) for N.(p) in (110). 

The nature of the approximation is explained further by Fig. 17. 
Curve (a) represents a more general NV, , including a “spike” at w = 0 to 
allow for drift errors, etc. Curve (6) indicates the (qualitative) nature of 
the corresponding function | Y x |?w’. The variance, o”, is the integral of 
the product of these two functions. Therefore, the value of N is unim- 
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WHITE NOISE. 





| Yui]? ws (c) 





(a) =Ny3 (b) 


ie) O—> 


Fig. 17 — Explanation of a white noise approximation. 


portant in regions where | Yy |’w’ is very small. Thus, the white noise 
spectrum c gives about the same result as the actual spectrum N, . 


4.1.3 Constant Target Accelerations 


According to (118) and (119) increasing 7 always decreases co’. The o” 
of (118) and (119), however, is not the total variance a of the predicted 
z, except when the target acceleration may be neglected. The effect of a 
given target acceleration increases as 7’ increases, and this limits the . 
values of 7 for which (118) and (119) are good approximations to a2’. 

A higher order of approximation takes account of target accelerations, 
but assumes that they are constant over the interval i — T tot + a. 
If the Yy of (119) is retained unchanged, o3” becomes 


oe 127 


2 
oe = apr N2(0) + eae) oe. (120) 


Here, oz’ is the (ensemble) average squared acceleration of the target. 

A smaller o;’ may be obtained by modifying the conditions which de- 
termine Y y in a way which takes account of target accelerations. When 
the expected accelerations are large, it may be reasonable to strengthen 
(100) to the following: 


In the absence of observational errors, the future position of a 


target with constant acceleration 1s to be predicted perfectly. ey) 


The stronger condition reduces the function classes Cy and C4 to the 


LINEAR LEAST SQUARES SMOOTHING AND PREDICTION 1281 


subclasses of (47) and (48), such that 


a. Yep) ~-1+tap as p—O, 
| : (122) 
b. Av(p) S< cp as p—O. 


These changes in Cy and Cy lead to the following changes in (110): 
condition (110a) is replaced by (122a); the factor p’ in (110c) and (110d) 
is replaced by p*. The white noise assumption leads to the following, in 
place of (119): 


Ku(t) = Be i(T — t) E + ae (T — 2 |, 


- ik +15(1+$) |w.() 
T3 T ee 


If the expected acceleration does not have a large effect in (120) with 
the largest T for which observations are available, full compensation may 
not be justified. (The compensation increases the sensitivity to observa- 
tional errors unless 7’ can be increased.) A possible, though more compli- 
cated procedure is then as follows: Assume that the target acceleration 
is: nonzero but time-invariant, and that the ensemble average of the 
squared acceleration is o;’. Then minimize the combined effects of the 
target acceleration and the observational errors. . 

The combined effects now give 


+00 pe 2 
C= | | Ye |? Nw dw + oz E& — “| . (124) 
— CO p 2 p=0 
To keep the second term finite, (106) and (107) are again in order. For 
a minimum a: , 


+i00 +10 Ay Yu 4 “ 
pea Jap +f [ Jap + 2| 8% (teat 8) | = 0, (125) 


in which the integrals are the same as in (109). The conditions (110) are 
now modified to permit simple poles of the two integrands at p = 0, 
which cancel out in their sum. The two contours of integration may be 
indented at p = 0, provided they are indented in the same way. Condi- 
tions (110c) and (110d) permit one contour to be closed at infinity around 
the lhp, and the other around the rhp. Then the residue theorem makes 
one integral proportional to Ay/p at p = 0, and parameters can be ad- 
justed to cancel the last term in (125).* The result is 

* The contour may be indented to pass to either side of p = 0, provided the 


indentation is the same for both integrals. The final results are the same because 
the poles of the integrands at p =0 cancel out in their sum. 


(123) 
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ips mer — t) (1 +o[%t Oe 2 |, 
= an {1 +Q E ( + =) | v.(0)} ; (126) 
ee ON 


4.1.4 More General Target Accelerations 


Comparing (123) with (120) shows that compensation for constant 
target acceleration increases the sensitivity to observational errors, un- 
less T is increased. (This is because the observation of acceleration, as 
well as velocity, is included implicitly in the new Y,y .) Sensitivity to 
fluctuations in the target acceleration is also increased, and becomes 
greater as T increases. In principle, Y » can be modified further, to give 
perfect prediction in the absence of observational errors, whenever the 
acceleration is matched perfectly by, say, an nth degree polynomial with 
random coefficients.* The sensitivity to observational errors will be fur- 
ther increased, unless 7’ is increased. However, any reasonable accelera- 
tion ensemble which involves only a finite number of random parameters 
will lead to a Ya such that o > Oas 7 —> o, 

The infinite memory problem may be handled more reasonably by 
assigning a spectrum, N; , to the target accelerations. Then (105) may be 


replaced by 
2 N: 


-}0o 
oF = [ [ Ye|N.w + 
If the optimum impulse response K y,(¢) corresponding to Y y(p) is neg- 
ligible when t > t», , there may be no advantage in extending the inter- 
val of observation to times older than ¢ — t, . The practical significance 
of a quantitative limit may be weakened, however, by the non-Gaussian 
character of actual target statistics. 


i 


atw 








4.2 Measurements with Multcple Instrumentst 


This section describes further the two-instrument problem noted in 
Section 3.4. It will be assumed that s(t) is to be estimated for present 


* Blackman?¢ has related the corresponding Ky(¢é) to Legendre polynomials. 

+t The use of multiple instruments is described in more detail in reports?» 5 & 
relating to specific applications. Principles are described in papers by Bendat!* 
and Stewart and Parks.15 


LINEAR LEAST SQUARES SMOOTHING AND PREDICTION 1283 


time, ¢, and need not be predicted for a future time, ¢ + a. When a = 0, 
(73) becomes 


+00 
o = [ (| Ya ? M1 “te | Yor No + | Ya + VYe.— 1 |S) du. (128) 


In (72) fi(é) and fo(¢) are now the results of observing a physical varia- 
ble, s(t), with two different instruments. Then N, and N2 are the spectra 
of the instrumental errors 7,(é) and no(t). 


4.2.1 Elimination of Errors Proportional to True Signal 


When the two instruments have reasonably high percentage accuracies, 
S >> N, and Nz. Then the Yq and Y¢ which minimize o” in (128) will 
make Y «+ Yeo — 1 very small. Under these conditions, it is reasona- 
ble to approximate the true optimum by making the factor exactly zero. 
Then Y @ is related to Y @ by 


Y ee = 1 — Ya . (129) 


Under (129), the S term in (128) drops out. Using Y¢ to represent Y a 
and 1 — Yg to represent Y ge gives 


=f (¥ehM+11- Yo |’ N2) dw. (130) — 


Now, o’ is to be a minimum with respect to the single-frequency function 
Ve * : 
Formally, (180) is exactly the same as (19) (with a = 0). Rational 
spectra N and S have merely been replaced by rational spectra N; and 
Nz. Thus the whole of Sections 3.2 and 3.3 may be applied. 


4.2.2 Determination of Position from Position and Velocity Measurements 


As an example, suppose an aircraft’s position is measured with one 
instrument and its velocity with another, and that the two measurements 
are to be combined to determine the present position to high accuracy. 
Let N, and N, be the error spectra of the position and velocity observa- 
tions. Then, if all errors are referred to positions, N; = Nz, N2 = N,/w, 
and (130) becomes 


+o0 
a = i ( Ye i N, + | il = Yq |? *) dw. (131) 
— 00 w 


In (131), o” will be bounded only if Y (0) = 1 [assuming that 
N,(0) ¥ Oj. When Y¢(0) = 1, applying Y<¢ to a constant position leaves 
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the position unchanged. This situation may be interpreted as follows: 
By (18), any Y« applied to the true position yields a weighted integral 
of the true positions existing during the “smoothing interval’. When 
Y,(0) = 1, the weighted integral is a weighted average, and the position 
measurements are used to determine a weighted average position, aver- 
aged over the smoothing interval. When the position is not constant, the 
present position will generally be different from the average, and the dif- 
ference may be calculated from the velocities observed during the aver- 
aging or smoothing interval. The correction may be said to “update” 
the average. The first term in the integrand in (131) corresponds to errors 
in the weighted average position, determined from the position measure- 
ments, and the second term corresponds to errors in the updating, deter- 
mined from the velocity measurements. 

If the position measurements are used alone and if guessed velocities 
are, in fact, quite uncertain, an adequate smoothing interval may lead 
to large updating errors. On the other hand, if the velocity measurements 
are used alone, they must be integrated over the entire time of flight, and 
velocity errors may accumulate into large position errors. Thus, the two 
instruments together may give a very much higher accuracy than is 
possible with either instrument alone. This may be explained further by 
citing differences between the spectra N, and N,/w’, and comparing Y g 
and 1 — Yg, in (131), to the transfer functions of a pair of separating 
filters. 


4.2.3 Precalculated Information 


Sometimes, the second measurements may be either replaced by, or 
augmented by previous nonstatistical information concerning the physi- 
cal variable. The “biased statistics’? may be taken account of as follows: 
Let so(t) be a precalculated ‘nominal’ s(é), which may be regarded as 
the ensemble average of s(é). Then let 


s(t) = s-(t) + sol), 
f® = fd) + s0o(8), 
g(t) = g(t) + sold), 


S = spectrum of s,(é) ensemble. 


(132) 


The time series s,(é) with spectrum S may be regarded as the error in the 
prediction of s(¢) without measurements, by precalculation alone. The 
time function g,(t) is to be obtained by applying operator Ye(p) to 
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f(t) = f(t) — so(t). Then g(t) may be found by adding so(t) to g,(t). The 
error integral (128) is unchanged, provided S is redefined as in (132). 

If Yeo = 0, in (128), the second measurements are replaced entirely 
by the precalculation of so(t), and the error in the second measurements is 
replaced by the error in the precalculation. If Ye: isneither 0 norl — Yg@, 
the estimate of s(¢) is based on three sources of information: the two kinds 
of measurements and the precalculation of so(é). Whether the full gener- 
ality is justified depends on the relative magnitudes and spectra of the 
three corresponding errors. 


4.3 A Signal Detection Problem. 


This section describes a simple problem related to signal detection. 
The time function f(t) = s(¢) + n(Z) is again observed and g(é) is again 
produced by applying, to f(é), a physical linear operator Y¢(p). Now, 
however, the true signal s(¢) has the following properties: it is a time func- 
tion which has finite duration and a known shape, but which starts at an 
unknown time. It may be represented as follows: 


st) =rt—t), h<t<iitw 
— 0, t< or >t +w (133) 
t; = a random variable. 


In the absence of noise, the response g(é) will have a maximum value at 
some value of (¢ — 4). The contribution to g(é) from the noise n(¢) will 
have an rms value. We are to find a particular linear operator Y 4 which 
minimizes the ratio of rms noise response, to maximum response to true 
signal. . 

Since only ratios are of interest, the scale of Ys», may be chosen to give 
a unit maximum true response. Then the problem is to minimize the rms 
noise response within this constraint. Given any valid solution for Y a 
producing a maximum true response at, say, 4 + tn , there will be equally 
valid solutions producing maximum responses at later times. The oper- 
ator Y x can always be multiplied by ¢ ””, representing an ideal delay 8. 
Thus, if ¢, + tis the time of maximum true response, ¢, may be treated 
as an arbitrary parameter, provided the final results are examined, to 
determine what values of ¢,, are, in fact, valid. 

When ¢ = 4 + t» (183) makes s(¢ — 7) become r(tm — 7). Then Ya 
is the physical Y¢ which minimizes the following o”, subject to the fol- 
lowing constraint: 
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oo 
a =| \YoPN de, 
2 = (134) 
[ i ee Oe ee 


Let Y,(p) be the transform of r(tn — 7), regarded as a function of 7. 
Then, by Parseval’s equation (T-14), the constraint may be written 
-boo 


Ve dw = 1, 
2 (135) 


Y,(p) 
The isoperimetric method of the calculus of variations may now be 
applied in the following way: When Y< is replaced by Yy + Ay, (134) 


and (135) each yield an integral which must vanish. The two integrals 
may be summed in arbitrary proportion to get 


transform of r(t, — 7). 


+i00 
[ _ (YuN — kY,)Ay dp = 0, (136) 


Veo 


in which k is an initially undetermined constant. The methods of Section 
3.2 then givet 





Pave ~ sarily: (137) 


N 


These can be solved for the physical Y x, , in either frequency-domain or 
time-domain terms. The resulting Y sis proportional to k, and k may then 
be determined by (1385). 

After further manipulation, the corresponding noise ratio turns out 
to be 


ee ee 
[ Caan a 


2 
ee ge 


Y,(p) (138) 
Yx(p) 





K,n(r) = inverse transform of 


1 
= r(tm — 7) * (inverse transform of a) . 


In the formula for o°, the integration runs from 0 to . In general, 
K,x(r) ¥ 0 when + < 0, but increasing 7, shifts K,w(r) along the time 


+ Recall the definition of Yy by N = YyYvy , in Section 2.3. 
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axis in the direction of 7 > 0. Then the corresponding g,,° must decrease. 
It approaches a minimum value asymptotically, as tm becomes so large 
that the “tail” of [K,y(7)/ at 7 < 0 becomes negligibly small. 

When N is either a constant or the reciprocal of a polynomial 1/Yy 
is at most a polynomial in p and K,y(7) = 0 when + > w, which is the 
length of the signal r(é — &) as defined in (133). Then o” reaches its 
asymptotic value as soon as t, 2 w. When N has zeros at finite values 
of p, om approaches its asymptotic value only when ¢,, exceeds w by the 
effective correlation time of the spectrum 1/N. 

When N is a constant, corresponding to white noise, the optimum im- 
pulse response is Ky(r) = r(tm — 7). Then Ky may be described as a 
mirror image of the given signal form, r(é — ¢,), as illustrated in Fig. 18. 
This is an old principle described, for example, by North.” The more 
general solution, for N # constant, has been described by Zadeh and 
Ragazzini.” 

A variation of the present problem restricts the class Cy , of permitted 
frequency functions, Y¢, to the finite memory class considered in Sec- 
tion 3.3. The problem may be solved by combining the methods of this 
section and of Section 3.3.4. 

When N — 0 as w — ©, it is easy to find pulse shapes such that the 
values of Section 2.2 and 2.3 regarding behavior at © are violated unless 
k = 0 in (136). The corresponding c,,’ does, in fact, = 0. An explanation 
is as follows: 

Suppose the (m — 1)th derivative of r(é — th) is discontinuous and 
consider a Y¢(p) which approaches cp, as p — ©. The corresponding 
response to r(¢ — ¢,) will include a 6 function and its maximum value will 
be «. If, at the same time, the noise spectrum N = Ow “"' asw—> o, 
the rms response to the noise will be bounded and the ratio of rms re- 
sponse to noise to maximum response to true signal will be 0. If 
N — cw °”, the rms noise itself will be ©, but it can be shown that the 
ratio of noise to maximum signal response will still be 0. Compare these 








ggeas 
‘: { 
1 
~ 
eet ay 
et : 
oo 
a x 
a 
t; tt fe) T — > 


Fig. 18 — Time functions which are mirror images. 
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conditions with the continuity conditions described in Section 3.3.4. 
Actual pulse shapes and noise spectra are not likely to behave in this way, 
but what appear to be good approximations may. Care must be used to 
choose approximations which behave properly as p > ©. 


4.4 A Principle Relating to Diversity Systems 


This section adapts the method of Section 3.4 to the following prob- 
lem: A single signal s(é), with known spectrum S(w), is observed by m 
different devices. (These may be, for example, the receivers of a communi- 
cation system using the diversity principle.) The signal actually observed 
by device & is f,(t) = s(t) + n,(t). The m different n,(¢) are uncorrelated 
and have known spectra N;.(w). Finally, the various noise spectra all have 
the same shape, but they differ in amplitude. Thus, 


Ni.(w) => JN (w), e= 1, vse 5 mM, (139) 


where the J; are known constants and N(w) is a known function. The 
optimum physical filters are to be determined for estimating s(¢ + a) by 
summing linear operations on the various /;(t). 

Paralleling (78) gives 


a. Y yx is rrhp, 


b. >) Yanks; — eS is rihp, 
: 


Fur = S -+- JN, 
| (140) 
Fy; = S, J rad k, 
c. When w is real and > ~, 
| Yaw |? Nand | >> Yan — e°? |? S = Ow”. 
k 
The indices & and 7 run through the integers 1 to m. 

A set of m equations similar to the pair in (79) may now be solved for 
the Ya, , in terms of (unknown) rlhp functions U;. Under the special 
conditions which we are now assuming, however, a solution is obtained 
more simply by examining linear combinations of the conditions (140b), 
which give 

N ied 
Rey ee > Yan — e°S is rlhp, 
k i 
LF (141) 
(JY ax — Ji¥ u;)N is rlhp. 


The second of these conditions can be satisfied, within the convergence 
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condition (140c), only if 
JY me = J iY a3 . (142) 


Because of (142), the various f;,(¢) may first be summed with weights 
proportional to 1/J; and then a single frequency-dependent operator 
may be applied to the sum. In other words, only a single “filtering” 
device is needed.* This confirms a result which might reasonably be ex- 
pected without formal analysis. The optimum filter characteristic is 
proportional to >> Ya, and may be found by applying the methods of 
Section 3.2 to the first condition of (141). . 

The use of a single filter for all the channels may actually be dictated 
by cost considerations. The above analysis confirms its use on a per- 
formance basis. 


4.5 Nonstatistical Network Synthesis Applications 


Nonstatistical problems in network synthesis sometimes may be for- 
mulated in terms of the mathematics of data smoothing, even though no 
data smoothing is involved. In particular, reasonable solutions sometimes 
may be found by minimizing integrals similar to those which represent 
our o”. This has been pointed out by Chang,” with illustrations in terms 
of a frequency-domain theory of optimum infinite-memory networks. 
The possibilities appear to be much greater when a frequency-domain 
form of the finite-memory problem is available. Possible uses, however, 
have not been explored in detail. The example described below will il- 
lustrate how problems may be formulated. 

It will be simplest to develop the example in two stages. We will be- 
gin by seeking a physical network function Y«¢(p) with the following 
properties: The ‘‘step response” is to have a “rise time” 7’ and is to be 
exactly 1 thereafter, as in Fig. 19(a). At the same time, | Y¢ |’ is to be 
small at real frequencies above a cutoff frequency, w = w,, as in Fig. 
19(b). More exactly, | Yc |’ is to be as small as possible, within the rise- 
time restriction. In order to apply the mathematics of data-smoothing, 
we will use an average square criterion o” to judge the effective smallness. 

The impulse response K ¢(t) is the derivative of the step response. It 
will have to be zero when ¢ > T’, as in Fig. 19(a). Also, Y(O) is equal to 
the step response at 1 = «, and it will have to be exactly 1: 


Kt) =0 when t> TT, 
Y ¢(0) = 1 


* When the NV; are not related as in (139), the Yaz, generally share a common 
set of poles, but differ in regard to the residues at the poles. 


(143) 
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Fig. 19 — Requirements imposed on a network response. 
If the average-square criterion o”, applied to | Y|’, is unweighted, 
2 i 2 
a | | Yo |? du. (144) 
The limited range of integration, however, makes the minimization prob- 


lem very difficult. A more tractable compromise is the following weighted 
average-square: 


-+oo 
f= [ | Yel? R de, (145) 


where 


ae) 
I 


a rational function of w, 


= an even function = 0, 


= small when w is small. 


The problem now is as follows: find the particular ‘‘physical” function 
Y u(p) which makes o of (145) a minimum, within the constraints (143). 
Mathematically, this is exactly the problem described in Section 4.1.1, 
except that the weight factor R replaces spectrum Nw’. 

Details of the weight factor R are arbitrary. They influence the dis- 
tribution of the loss, due to the network, in the high-loss region w > w,. 
An efficient choice of R may place zeros and poles on the axis of real w, 
with zeros < w, and poles > w,. Real zeros and poles must be in identi- 
cal pairs to preserve R = 0. One of each pair is interpreted as in each half 
plane, and | Yy |’ will always have zeros at real w poles of R. Further 
analysis indicates the following: 

When all zeros and poles of FR are at real a, 
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ReiWe = 
(146) 


Vu = 7 (u ca tie” *”). | 
Poles of 1/W are canceled in Y 4 by zeros of the other factor. The func- 
tion w may be determined by adapting the method of Section 4.1.1. 

The problem may now be modified in the following way: the step re- 
sponse need only approximate 1 when ¢ > 7. The approximation is to 
be judged on an average-square basis. There are now two average square 
criteria, referring respectively to the step response and the frequency 
suppression. The two criteria are to be added to obtain a measure of 
over-all performance. Since the step response is the integral of the impulse 
response 


-+oo ) T 2 
an = | | Ve : R dw + [ I Ke(n1) dry — i] dr, (147) 


the relative importance of the frequency suppression and the step re- 
sponse may be adjusted by adjusting the scale of the weight factor R. 

The problem may be solved by splitting Y<¢ into the following two 
parts: 


Yap) = Yi(p) + pY¥2(p), 
Ki) =0 when t> T, 
¥,0) = 1, 

Kft) =0O when t< TI. 


(148) 


The impulse response of Y2 is the integral of the impulse response of 
pY> (and is therefore equal to the step response of pY2). Then the con- 
straints on K,(7) and K2(7) are such that 


ia | [/ Koln) des - i] de = [ (Kal) dr. (149) 

Applying Parseval’s equation (T-15) now gives: 
g= [nt erlRt|Y. P| deo. (150) 
The problem now is as follows: Find the “physical”? Y; and Y2 which 
make o’ a minimum, within the constraints (148). The problem may be 


solved by combining the method of Sections 3.3, 3.4 and 4.1.1. 
The optimum network function Y y(p) is not realizable with a finite 
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network in either form of the problem, but it may be approximated ar- 
bitrarily closely. It should also furnish a reference for judging the per- 
formance of finite networks designed in other ways. The method has not 
yet been tested by detailed calculations. 


4.6 More General Modifications of the Central Problems 


The specific problems described in Sections 4.1 to 4.5 illustrate various 
more general ways in which the central data smoothing and prediction 
problems may be modified. These include the following: 

i. The restriction of the function class Cy, by constraints which 
specify the response to certain frequencies (Section 4.1) or to certain more 
general time functions (Section 4.3). 

ii. The substitution of simplified spectra, which approximate true 
spectra only at frequencies which are actually utilized (Section 4.1.2). 

iii. The addition of signal or noise functions which involve a finite 
number of random variables (Sections 4.1.3, 4.1.4). 

iv. The estimation or prediction of a functional of the true signal, 
rather than the signal itself (Sections 4.1.8, 4.1.4). 

v. The substitution of random variables other than signal and noise, 
and the treatment of “biased” statistics (Section 4.2). 

vi. The use of more than two simultaneous observations (Section 4.4). 

vii. The application of the mathematics of data smoothing to non- 
statistical problems (Section 4.5). 

Other modifications are possible, which have not been illustrated. For 
example, correlations between signal and noise may be handled very 
simply, by modifying the physical model illustrated in Fig. 8. It is only 
necessary to change the associated frequency functions, so as to generate 
the correct pertinent covariances listed in Section 3.2.4. The methods of 
Section 3.3 and 3.4 may be combined, to find two optimum operators 
Ye, Y eg: restricted to finite memories. The single operator problem may 
be solved for signal and noise situations which are different in different 
segments of past time. In a special case, n(7) is observed when —o < 
7 <t-— T, and s(r) + n(r) is observed when ¢ — T < 7 < t. Added 
complications, however, are likely to increase very drastically the num- 
ber of simultaneous linear equations which must be solved to find Y a(p). 

A general solution of the following problem would be of interest to 
engineers, particularly in connection with preliminary system studies: 
Suppose the signal or noise spectrum is not known in detail but is known 
to lie within some sort of limits. What Y, will give the best protection 
against a large o? If the most unfavorable permitted spectrum is asso- 
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ciated with each Yg¢, what Yg will make the corresponding o’ a mini- 
mum, and how large will the minimum be? It appears that no general 
solution of this problem has been achieved. 
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Automatic Number Identification 


and Its Application to 
No. 1 Crossbar, Panel and Step-by-Step Offices 


By D. H. PENNOYER 
(Manuscript received February 28, 1958) 


Automatic number identification provides facilities for automatically 
obtaining calling customers’ directory numbers in No. 1 crossbar, panel 
and step-by-step central offices and transmitting these numbers to a tandem 
or toll office for recording on centralized automatic message accounting 
equipment for billing purposes. Present centralized automatic message 
accounting systems require operators to request the calling customers’ 
numbers and to key these numbers into recording equipment. The new facil- 
ities feature a simplified procedure for customers, improvement in speed of 
service and greater accuracy of billing records. Offices with local automatic 
message accounting facilities already have these features and are not can- 
didates for automatic number identification. 


I. INTRODUCTION 


As the range of customer dialing has been extended, it has become 
increasingly important to provide arrangements for automatically 
recording and processing the data required for billing these calls. To 
accomplish this, a system using punched tape recording and known as 
automatic message accounting (AMA) has been developed. This system 
has been arranged for local office application in No. 1 crossbar, No. 5 
crossbar and step-by-step offices. Here, automatic number identification 
is an integral part of the system. This application is economical only 
when calling rates for customer-dialed multiunit traffic and toll traffic 
are relatively high; in places where the calling rate is low, AMA features 
may be located more economically at a tandem or toll-switching location. 
This is known as centralized automatic message accounting (CAMA). 
In its earlier arrangement, an operator has been bridged on the connec- 
tion momentarily to obtain the calling number and to key it into the 
system. Automatic means of performing this action have been developed 
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and it is the purpose of this article to describe automatic number 
identification (ANI) as it applies to No. 1 crossbar, panel and step-by- 
step types of local offices. As it is to be applied to No. 5 crossbar offices 
without local AMA, automatic number identification is of a different 
type and is beyond the scope of this article. 

Automatic number identification as presently developed is for use 
with one- and two-party lines. Multiparty lines are recognized as such 
and their calls will be referred to a CAMA operator for identification. 


Ii, METHOD OF OPERATION 


Fig. 1 is a block diagram of the major equipment items required for 
automatic number identification, exclusive of maintenance facilities. 
These are: 

1. an ANI outgoing trunk circuit 

2. a link circuit to connect the trunk to an outpulser 

3. an outpulser and identifier-connector circuit to seize and prime an 
identifier 

4, an identifier circuit to determine the calling customer’s number 
and forward it to the outpulser, which in turn transmits the number to 
the CAMA office 

5. a number network and bus system to connect each customer’s 
directory-number sleeve wire to a grid of bus panels and to connect the 
output of these panels via an identifier connector to an identifier. 

Fundamentally, the operation is quite simple. A call proceeds in the 
normal fashion until the called number has been transmitted to the 


NO.1 CROSSBAR, PANEL OR CAMA OFFICE 
STEP-BY-STEP OFFICE CROSSBAR 
TANDEM OR 
44 TOLL 







oe 





























































DISTRIBUTING 
FRAME | 
<= LOCAL eee | INCOMING | 
TO SWITCHING SYSTEM TRUNK | TRUNK ! 
CUSTOMER \ | | | 
DIRECTORY L—~—-—--4 
NUMBER ees eee 
SLEEVE 
TERMINAL | | 
| | LINK | 
| {____4—4 
ees | 
rT aaa | 
NUMBER NETWORK ST eureen || | 
BUS SYSTEM IDENTIFIER NP | CAMA | 
(AND IDENTIFIER PORN EETEr | | SENDER 
CONNECTOR) nINEeIeR eee 4 








Fig. 1 — Block diagram of automatic number identification system. 


AUTOMATIC NUMBER IDENTIFICATION 1297 


CAMA sender, whereupon the identification equipment comes into 
play. This action is initiated by the outgoing trunk, which establishes a 
connection through the link to an outpulser. This circuit, by means of 
connecting facilities within itself, seizes an identifier. The identifier 
connects itself to the number network and bus system and signals the 
trunk to apply an identification signal to the sleeve wire toward the 
local switch train. This identification signal is a 5,800-cycle frequency 
at approximately two volts, and it finds its way over the sleeve of the 
switch train and back to the customer’s line equipment. Here the path 
continues through the distributing-frame cross connections that attach 
directory-number significance to the line circuit, and the identification 
signal reaches the directory-number sleeve terminal. All of these sleeve 
terminals are cabled individually to networks connected to a bus system. 
These buses are arranged in a grid pattern in such a manner that the 
identifier can quickly scan the groups of output leads and identify the 
central office and the four digits of the calling number. This information 
is transferred to the outpulser, which forwards it to the CAMA point 
by multifrequency pulsing. Then the outpulser releases its connection 
through the link and the trunk connects the transmission circuit through 
for talking. 

At the CAMA office the calling number is recorded on AMA tape 
along with the other information required for billing purposes. After 
switching of the call is completed, the called customer’s line is rung, and 
when answer and disconnect take place, the corresponding timing entries 
are recorded under control of the supervisory equipment at the CAMA 
office. 


III. NUMBER NETWORK AND BUS SYSTEM 


A unique and fundamental part of the identification arrangement is 
the network and bus system, for which the electrical equivalent is 
shown in Fig. 2. The customers’ directory number sleeve wires are 
cabled from the distributing frame to terminals on the number networks 
at panels in the primary bus system. The sleeve terminations are ar- 
ranged in a square pattern of 100 rows and 100 columns. Each sleeve 
wire is connected through a 0.05-microfarad capacitor and 510-ohm 
resistor to ground; the junction of these components is connected through 
20,000-ohm resistors to one vertical and one horizontal bus in the grid. 
Thus, each sleeve is associated with one of the 10,000 coordinate points 
in the grid and may be identified in terms of the vertical and horizontal 
buses to which it is attached. 
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If it were practical for the identifier to examine 200 buses to determine 
the calling number, no additional bus system would be needed. This, 
however, would require an excessive number of detectors. Therefore, 
an arrangement is provided using two secondary systems, each arranged 
in a square pattern of ten rows and ten columns. The primary buses 
are concentrated in the secondaries as shown in Fig. 2, with the vertical 
buses connected to one secondary grid and the horizontal buses to the 
other secondary grid. With this arrangement, an identifier equipped 
with ten detectors may be switched from one group of ten secondary 
buses to another. With an input signal at one of the number networks, 
an output signal will appear on one bus in each of the four secondary 
groups of ten, and the buses so marked correspond to the numerical 
digits of the customer’s number. Thus, the identifier makes four suc- 
cessive tests to identify completely a number in a 10,000-line unit. 

In the primary bus arrangement, the vertical buses are designated 
thousands and units and the horizontal buses hundreds and tens, as 
shown in Fig. 2. This particular numbering arrangement of the buses is 
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used to provide the most convenient grouping of networks on the number 
network panels, as illustrated for the 00-hundred group in Fig. 2. 

In multioffice buildings, a single group of ANI equipment may serve 
as many as six central offices, each having a maximum of 10,000 num- 
bers. In buildings containing more than six central offices, a second 
group of identification equipment is required and simultaneous identifica- 
tions may be made in the two groups. Successive groups of thousands 
buses are tested until a signal is found, then the hundreds, tens and 
units are examined to complete the identification. Office identification 
is accomplished by recognizing the particular thousands group in which 
the signal is found. 

In offices with two-party lines, the tip parties are connected to a 
second set of primary buses. Before the identifier connects to the sec- 
ondary buses, it is provided with information as to whether the calling 
customer is a tip party and, if so, it transfers the two secondary grids 
from the primary that contains the ring party numbers to the one that 
contains the tip parties. In this way, it differentiates between the two 
parties on a line in spite of the fact that the signal is present in the 
number networks for both parties. 

Many primary buses will have less than 100 number networks con- 
nected to them. This will occur in offices with two-party lines where 
the networks are divided between tip and ring bus fields; it will also 
occur in offices with four-party, multiparty or PBX lines, for reasons 
that will be described later. Actually, the handling of PBX lines is such 
as to result in connecting more than 100 networks to some buses. This 
means that the number of networks connected to a particular bus may 
vary from none connected to a full complement of 100 or more. In 
order to minimize the resultant variation in primary bus voltage, a 
20-ohm termination to ground is provided on each primary bus. This 
makes it easier for the detectors to discriminate between the wanted 
signal and the unwanted signals which result from backup paths through 
other networks. 

A number network consists of the capacitor and three resistors 
associated with a single customer’s directory number. These networks 
are mounted in groups of ten on a card approximately nine inches by 
three inches, photographs of which are shown in Fig. 3. The components 
are connected to brass details staked to the card in an unique pattern 
that facilitates joming them together and to terminals for external 
connections. The terminals for the capacitors appear at one edge of the 
card for cabling to the distributing frames. The terminals for the 20,000- 
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Fig. 3 — Opposing sides of card on which number networks are mounted in 
groups of ten. 


ohm resistors project from the opposite edge of the card in positions 
that facilitate strapping to either tip or ring party buses. 

The primary bus system is made up of panels, each of which accomo- 
dates twenty cards or two hundred number networks. A photograph of 
one of these bus units, partially equipped, is shown in Tig. 4. The 
panel itself is made of phenol fabric and, on the rear side, a grid of small 
buses is attached. These buses are arranged in vertical and horizontal 
groups. One bus of each group belongs to the tip party system and the 
other to the ring party system. At each position on the panel where 
buses cross, projections of these buses are carried through the panel to 
the front, where they appear as terminals for connection to the networks. 
Also at each position are two holes suitably positioned so that a card 
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of ten-number networks may be mounted vertically on the rear of the 
panel and have its 20,000-ohm resistor terminals project through the 
panel to the front. Ten bus panels are mounted vertically on a 23-inch 
frame, which thus serves 2,000 numbers. I‘ive such frames are needed 
for a full 10,000-number unit. Corresponding vertical buses on the ten 
panels of one frame are multipled vertically. Similar connections for 
the horizontal buses of the five frames of a central office are provided 
by interframe wiring. In crossbar offices with coded or “‘X’’ numbers, 
one or two additional frames are required for these networks (the method 
of connecting them will be described below). These numbers are outside 
of the 10,000-number series, and are provided for PBX use. 

In addition to the two vertical buses that provide for tip and ring 
party identification, a third vertical bus (not indicated in Fig. 2) is 
provided. To this are connected all four-party or multiparty numbers; 
one of the 20,000-ohm legs is used for this purpose and the other is left 
unused. The four-party and multiparty buses are grouped together 
through suitable networks so they can be examined by a single “‘party”’ 





Fig. 4 — Primary bus system unit, partially equipped. 
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detector in each identifier. The appearance of a signal results in the 
call being routed to an operator at the CAMA office, who will ask the 
calling customer for his number and key it into the CAMA equipment 
for recording on the AMA tape. 

Fig. 5 is a sketch of a transparent section of a primary bus panel, 
facing the front. It shows the physical arrangement of the buses and 
typical network connections, including a ring party, a tip party and a 
four-party or multiparty number, as well as the connections for PBX 
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numbers which will be described later. The connections between net- 
work terminals and bus terminals are solderless-wrapped, with short 
bare-wire straps being used for adjacent terminals and insulated wire 
for the others. Changes in party line assignments are easily effected by 
unwrapping the tio straps (one if multiparty) and wrapping two new 
ones. 

The secondary bus system has been so named because the term is 
useful in understanding its circuit function in conjunction with the 
primary system. Actually, it does not use buses like those in the primary 
system. The resistors that make up the secondary grids are mounted on 
the identifier frames, together with the relays that serve to transfer 
these grids from the ring to the tip primary system when a tip calling 
party has been indicated. Fig. 6 shows the secondary bus systems in an 
array that is convenient for circuit understanding. Each bus is divided 
at the middle and its two halves are connected to separate primary 
windings of the input transformers in the amplifier detectors. These 
primary windings are connected opposing each other so that the noise 
and other unwanted signals on the secondary buses will be largely can- 
celled out. 


IV. IDENTIFICATION ON PARTY LINES 


On calls from two-party lines, party information must be obtained 
and forwarded to the identifier so that the proper one of the two primary 
bus systems may be switched in before number identification. In the 
No. 1 crossbar system, tip and ring party information is registered in 
the originating marker in the standard manner while the call is being 
switched. This information is forwarded to the ANI trunk while the 
marker is setting up the switch linkages. I'rom the trunk, the information 
is passed on through the outpulser link to the outpulser and then to the 
identifier. In the panel system, the district selector makes the party 
test and records party information but it is not feasible to pass the in- 
formation forward to the trunk. Therefore, the ANI equipment must 
make a party test of its own. This is done by the outpulser, which 
recognizes the conventional ringer ground through the switchhook as 
indicating a tip party. In thestep-by-step system,a party test ismade 
by the ANI trunk during the interdigital time between the first two 
digits dialed after the trunk is reached, and the result is forwarded to 
the outpulser, as in the case of the No. 1 crossbar trunk. 

As indicated previously, calls for four-party and multiparty rural 
lines will not be individually identified but will be recognized as calls 
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requiring operator identification. This recognition is made by connecting 
the networks for these lines to the third vertical bus in the primary bus 
system and providing a special multiparty detector in the identifier to 
examine the output of the multiparty buses, after attenuation to 
simulate losses in the secondary bus system. In the event that an 
economical method for identifying the parties on a four-party line is 
obtained, automatic identification of these numbers can be made by 
providing an additional primary grid system for the third and fourth 
party numbers. By confining these numbers to selected hundreds 
groups, the additional grid would need to be only a portion of a full 
primary bus system, and this would serve to minimize the cost. 


V. PBX FEATURE 


Since calls from all lines in a PBX are ordinarily billed to a single 
account number, it is desirable in any automatic message accounting 
system to be able to record all these calls by account number on the 
original tape. This avoids cumbersome translating procedures in the 
accounting center. With ANI, this feature is readily available. The 
network corresponding to the billing number, like any ring-party cus- 
tomer, is connected to the ring-field primary bus system. The networks 
representing the other lines in the PBX, however, are not connected to 
the bus system at the locations where they are mounted. These are 
multipled, as shown in Fig. 5, to the terminals of the directory or billing 
number network. Electrically, therefore, they act as if they were all 
connected to the primary bus grid at the same location as the directory 
number network. This arrangement can be used for nonconsecutively as 
well as consecutively numbered PBX lines, although the nonconsecu- 
tively numbered lines require longer jumper wires for multipling. Some 
PBX groups may extend beyond a single number network frame. To 
care for these cases, terminal blocks are provided at the top of all number 
network frames and interframe tie cables furnish the connections be- 
tween frames. 

As indicated earlier, in No. 1 crossbar there may exist a special 
category of numbers sometimes called ‘X numbers” and sometimes 
“coded numbers” which are outside the 10,000-number series comprising 
a central office unit and which serve as additional lines for PBX groups. 
It is desirable that calls from these lines, like those from other PBX 
lines, be billed to a common billing number in the 10,000 unit. This is 
accomplished electrically in the same manner as for the nonconsecutive 
PBX lines. Physically, since they have no position in the 10,000-number 
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grid, they are connected to number networks mounted on a separate 
frame and cabled over to the base-number network. 


VI. OFFICE IDENTIFICATION AND OUTPULSING THE CALLING NUMBER 


During its search for the calling number, the identifier scans the 
groups of secondary buses by connecting its detectors to the thousands 
buses of each office secondary grid, one after another. Meanwhile, 
the identifier keeps tract of its progress and, when it finds the signal, it 
grounds a corresponding lead to the outpulser, thus enabling that circuit 
to register the office of the calling customer. During this action, the 
particular thousands digit registered in the identifier is being transferred 
to the outpulser. Thereafter the identifier scans the hundreds, tens and 
units buses and registers these digits in the outpulser. Although identi- 
fication is made on a one-out-of-ten basis, a translation is introduced so 
that registration in the outpulser is on a two-out-of-five basis. 

With the registers in the outpulser full and checked against missing 
or extra information, and the digit representing the office translated to 
the corresponding three-digit office code, the outpulser releases the 
identifier and starts outpulsing the calling number to the CAMA office. 
The information is sent in the following order: KP signal, information 
digit, three-digit office code, four numerical digits and ST signal. The 
KP and ST signals use the conventional frequencies that serve to 
actuate a receiver at the beginning and end of a sequence of information. 
The information digit serves to indicate one of four conditions: 

1. Calling customer identified automatically. 

2. Calling customer on a four-party or multiparty line, and therefore 
requires identification by the CAMA operator. No office or numerical 
digits are sent for these calls. 

3. Calling customer is under service observation, and therefore the 
AMA record for his call requires a service-observing mark in addition 
to the usual information. 

4, Calling customer could not be identified because of trouble in the 
automatic equipment. This condition requires identification by the 
CAMA operator. No office or numerical digits sent for these calls. 

When all digits have been outpulsed, the outpulser is released and the 
trunk is closed through for the talking condition. 


VII. AUTOMATIC NUMBER IDENTIFICATION IN COMBINATION WITH DIRECT 
-- DISTANCE DIALING 


The introduction of direct distance dialing (DDD) eliminates the 
need for an operator to control the switching of a call, and automatic 
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number identification will remove the need for an operator to obtain 
and record the calling number information. Hence it is natural that the 
two facilities would appear together in many areas. However, there are 
no design or operating conditions that make this imperative. Automatic 
number identification may be used in No. 1 crossbar and panel offices 
for seven- and ten-digit calls switched through tandem or toll CAMA 
offices. For the ten-digit calls, the called number is always outpulsed 
on a multifrequency (MI) pulsing basis and this requires an ‘‘MF- 
type” ANI outgoing trunk in the local offices. Seven-digit calls originat- 
ing in these offices and switched through tandem may use the panel call 
indicator method of outpulsing the called number and for this a ““PCI- 
type’? ANI outgoing trunk is provided. Other seven-digit ANI calls use 
the ‘““MF-type” pulsing. 

Direct distance dialing calls in step-by-step offices with ANI may be 
switched through tandem, toll, No. 5 crossbar or step-by-step intertoll 
offices equipped with CAMA. These calls outpulse the called number 
on a dial pulse basis, and usually require a preliminary or directing 
code to switch the call through the originating step-by-step office. 
Offices with automatic ticketing, whether converted to AMA or not, 
are not candidates for ANI, since they already have their own arrange- 
ments for identifying the calling customer. 


VIII. CIRCUITS 


8.1 Trunk Circuits 


The fundamental requirements for the ANI trunk circuits are similar 
in the three switching systems. These trunks must be able to recognize 
the correct time to perform the ANI function and then seize an out- 
pulser through the outpulser link. They must participate in several 
ways in the party-test function before number identification, and they 
must provide a path between outpulser link and outgoing cable over 
which the outpulser can forward the calling number after it has been 
identified. Then, after release of the outpulser, they must provide a 
transmission path with talking battery and ‘supervision toward the 
calling customer and trunk supervision toward the tandem end. Also, 
they must provide the necessary sleeve ground to hold the originating 
switch train. 

Due to inherent differences in the three switching systems, it has been 
found best to design separate trunks for each. Furthermore, variations 
within each of the systems in methods of pulsing and signaling have 
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resulted in two types of trunks for each system. In No. 1 crossbar and 
panel, one type is provided when the called number is to be transmitted 
by MF pulsing and the other type when PCI pulsing is used. In step- 
by-step, one type of trunk is provided for loop signaling and the other 
for the so-called “Ei and M lead” signaling which is required for the 
longer distances and when voice repeaters or carrier circuits are used. 

Crossbar and panel trunks must receive a signal from CAMA in- 
dicating readiness to receive the called number. For MF circuits, this 
signal is a momentary reversal of battery and ground and is relayed 
through the ANI trunk and back to the DDD sender as a go-ahead 
signal. For PCI circuits, the corresponding signal is the removal of 
battery and ground at the CAMA end of the trunk. At the time this 
occurs, the ANI trunk is cut through and the signal is transmitted 
directly to the subscriber sender (in this case, there is no DDD sender 
connected). 

All the ANI trunks need a ‘“‘start identification” signal from CAMA 
to indicate when that equipment is ready to receive the calling number. 
Crossbar and panel trunks must also recognize when the district junctor 
or selector has reached the cut-through position. Only then is the sleeve 
continuous, as required for transmission of the identification signal. 
Receipt of the start identification signal, together with detection of 
district junctor or selector “cut-through,” when required, causes the 
ANI trunk to initiate the identification function. 


8.2 Outpulser Link Circuit 


This circuit uses a six-wire, 100-point crossbar switch as the linkage 
medium for connecting trunks to outpulsers. One switch is required for 
each group of ten trunks. The control features are very simple and 
require one preference chain relay for each trunk and a group of three 
control relays per outpulser for each group of ten trunks. 


8.3 Outpulser Circutt 


The outpulser has a number of functions to perform. On some calls, 
as described earlier, it will receive party information from the trunk and 
on others it will be told to make party test by a signal from the trunk. 
Then the outpulser seizes an identifier, which, as it finds the signal, 
registers in the outpulser the office identity and numerical digits of the 
calling customer. If the calling customer’s line is one on which service 
observations are being made, the connected service-observing equip- 
ment will operate a service-observing detector in the identifier. An 
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indication to this effect is registered in the outpulser. As the digits are 
registered in the outpulser, they are checked and the digit representing 
the office is translated to the three digits representing the calling office 
code. Outpulsing to CAMA then takes place, with the calling number 
preceded, of course, by the information digit. This outpulsing is done on 
a multifrequency basis at the conventional rate of approximately seven 
digits per second. 

‘The outpulser is provided with checking and timing features so that 
it can detect a trouble promptly. In this event, the outpulser calls in a 
trouble-recording medium known as the “trouble ticketer” and pro- 
vides it with the significant information preparatory to printing the 
trouble record. The trouble ticketer is a new facility introduced with 
the ANI equipment and will be described later. After making the trouble 
record, the outpulser makes a second trial identifier seizure. 


8.4 Identifier Circutt 


Consider a building with several central office units and a common 
group of identification equipment. For each ANI call, the identifier 
must test the thousands secondary buses for each office, one after 
another, and, when the signal is found, test successively the hundreds, 
tens and units buses in that office. Fig. 7 shows how the identifier 
performs the steering and testing functions and registers the results of 
its search in the outpulser. 

During the search from one office to another, the thousands steering 
relay THS in the digit steering circuit is held operated. Relays oro, oF1, 
etc., in the office-steering circuit operate successive identifier connector 
thousands relays TH in the secondary network and bus connector circuit. 
These relays close, in succession, the detector inputs to the thousands 
secondary buses of the different offices. During this time the register- 
steering circuit holds the detector outputs closed to the thousands 
translation circuit relays THRO-9. When a signal is found, the operated 
detector energizes its associated THR- relay representing the digit 
received. The THr- relay operates two-out-of-five thousands relays TH- 
in the thousands register of the outpulser circuit, thus registering the 
thousands digit of the calling customer’s number. At the same time, the 
identifier office-check relay ork operates and, in conjunction with the 
energized office steering relay oF-, operates an office relay oF- in the 
office register of the outpulser circuit. This latter or- relay registers the 
office containing the calling customer’s number. Further advance of the 
office steering circuit is blocked by relays not shown. 
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Meanwhile, the operation of the ork relay has brought the digit 
steering circuit into play, and it operates, successively, the hundreds, 
tens and units steering relays HS, TS, and us over paths not shown. These 
relays operate the corresponding secondary network and bus connector 
H, T and U relays, which serve to connect the detector inputs successively 
to the hundreds, tens and units secondary buses of the identified office. 
At the same time and in synchronism with this sequence, the detector 
outputs are connected to the hundreds, tens and units translation 
relays, which function to register the corresponding digits in the proper 
outpulser registers. During periods of light load, the identifier will not 
only scan successive office buses until the signal is found but will con- 
tinue its search thoughout the remaining offices, in order to pick up 
troubles that cause wrong detector operation. The action of the circuit 
in case it encounters a trouble condition will be described later. 

In one identifier group, which may serve'as many as six central 
offices, only one identifier can be connected to the bus system at a time. 
Therefore, it is important that the search be completed quickly so as not 
to delay the traffic. The average identifier holding time is approximately 
0.27 second for the largest groups and is less, of course, for others. With 
this speed of operation, the ‘‘one-at-a-time” identification method will 
care for traffic greatly exceeding the amount now foreseen for any group 
of six offices. In buildings having more than six offices, two or more 
independent identifier groups will be furnished and may operate si- 
multaneously. Features in the detectors for discriminating between real 
and spurious signals require that the detectors be connected to the 
buses for 12 to 15 milliseconds for each test. Additional time for operating 
the register relays in the outpulser and for transferring detectors between 
tests, as well as for the initial circuit preparation, bring the over-all time 
up to the value quoted. 


8.5 Operation in Case of Identification Failure 


The identifying signal may be blocked temporarily in the panel system 
if the brushes of a hunting selector bridge a grounded terminal to a 
terminal carrying a signal. It may also be blocked temporarily in a 
step-by-step office as a selector wiper hunts across a terminal carrying a 
signal. These conditions can result in a failure to identify one or more 
digits of the calling number. To care for this situation, the identifier is 
arranged so that, if digits are missing, it will make a retest to fill in the 
missing digit or digits. If the retest is successful, no trouble record will 
be made. 
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If the identifier is unable to make an identification in two tests, a 
trouble is assumed and the outpulser is so notified. This circuit seizes 
the trouble ticketer (as previously described) and gives it information 
for a trouble record. The outpulser then releases the identifier and makes 
a second trial, using the other identifier, if available. In the event that 
the second trial should fail in two tests, the outpulser sends out the 
proper information digit to call in the CAMA operator for identification. 


IX. TRANSMISSION AND DETECTION OF IDENTIFICATION SIGNAL 


Considerable study and testing, both in the laboratory and in the 
field, was done to determine a suitable voltage and frequency for the 
identification signal and to develop a reliable amplifier-detector. The 
upper limit on the signal voltage was found to be controlled principally 
by induction into adjacent circuits on panel office selector banks and 
consequent disturbance to transmission. Field tests indicated that the 
voltage of the signal on the switch train sleeve must not greatly exceed 
two volts, assuming operation to be within the frequency range imposed 
by limitations to be described later. The signal undergoes considerable 
attenuation, particularly as it is transmitted through the translating 
resistors of the number networks and through the coupling resistors be- 
tween primary and secondary bus systems. Fig. 8 is a simplified circuit 
showing the path of the signal from the directory number sleeve to the 
amplifier. This path is, in effect, a series of voltage dividers. Typical 
voltages are given at successive junctions along the path. The nominal 
value of the final voltage at the input to the amplifier-detector is 90 
microvolts. This signal must be amplified to approximately 90 volts to 
operate the registering device, representing a voltage amplification of a 
million times, or 120 db. 

The determination of a suitable frequency for the identification signal 
was made after experimentation with several lower values in the field. 
At 1,900 cycles, the induction crosstalk into the panel selector banks was 
sufficient to be audible to customers using other circuits in the office. 
Frequencies in the nighborhood of 200 cycles are clear of this objection, 
partly because of the reduced sensitivity of the ear and partly because of 
lower coupling. However, this frequency would be more difficult to dis- 
tinguish from surges and would require a longer operate time in the de- 
tector, as will be evident later. When the frequency was raised from 1,900 
to 5,800 cycles, the noise on disturbed circuits was reduced to an insig- 
nificant level. This was due in part to the effect of lessened receiver sensi- 
tivity and in part to masking by noise from other sources in this fre- 


AUTOMATIC NUMBER IDENTIFICATION 1313 


quency range. Regarding the upper limit on the frequency, a major 
consideration is the avoidance of interference into program circuits and 
carrier facilities by secondary induction. Although these circuits would 
not be in the same cable with the signal carrying sleeve, they may be in 
the same outside cable with the identified customer’s pair, which does 
pick up some signal because of electromagnetic coupling with the associ- 
ated sleeve lead through the switch train. 

As for the transmission path of the identification signal, large varia- 
tions must be met in the conditions contributing to the load on the sleeve 
lead and in the elements causing momentary interference. As previously 
described, the selectors in the panel and crossbar switch trains are in the 
“operator talking” condition, and this requires a very low-resistance de 
ground on the sleeve from the ANI trunk during identification. To meet 
this requirement without placing too heavy a load on the oscillator, an 
inductor is used which has approximately 0.5 ohm de resistance and 
450 ohms impedance to the 5,800-cycle signal. Panel offices, unlike cross- 
bar and step-by-step offices, present a 2-microfarad capacitor in series 
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with the switch train sleeve, and either 220 ohms to battery or 112 
ohms to ground on the number network side of the capacitor. Additional 
resistance in the transmission path may be encountered at the sequence 
switch brushes and multiple bank brushes, or even at relay contacts. 
All systems have a great variety of relay or crossbar switch hold-magnet 
windings connected to the sleeve. On the identified sleeve, these con- 
stitute an additional load. On nonidentified sleeves, these magnets may 
be releasing and producing surges and voltage peaks which impose a 
nonoperate requirement on detectors that are examining the corre- 
sponding buses at the time. All of these conditions contribute to the 
operating requirements and margins of the amplifier-detectors and of the 
ANI system. 


X. FEATURES OF THE AMPLIFIER-DETECTOR 


In much of conventional amplifier-detector design, the margin be- 
tween operate and nonoperate conditions is largely determined by the 
signal-to-noise ratio. Where both signal and noise are in the same fre- 
quency band, discrimmation is made by amplitude. In ANI, however, 
there are times when the unwanted signal approaches or even exceeds 
the wanted signal in amplitude and is indistinguishable by frequency. 
Fortunately, these times of high unwanted signal are of short duration, 
because they are caused by various transient conditions in the switch- 
ing systems. 

Some of the features of the amplifier-detector that provide the needed 
amplification and yet retain adequate discrimination against the summa- 
tion of unwanted signals are of interest. Fig. 9 is a simplified sketch of 
the amplifier, divided into sections for descriptive purposes and with 
representative voltages indicated at significant points. As previously de- 
scribed, the two input leads of the amplifier are connected to the two 
halves of the secondary bus and the primary windings of IN transformer 
are connected opposing. With this arrangement, much of the noise on 
the secondary buses is cancelled out. The 11 and 12 inductors, in con- 
junction with the reflected capacitative impedance looking into the 
primary winding of In transformer, constitute a bandpass filter. As low- 
frequency components of noise enter the amplifier, this filter removes 
practically all of each surge except the spikes associated with the steep 
wave fronts. This is necessary in order to prevent surges and 60-cycle 
pickup from blocking the legitimate signals by overloading the ampli- 
fiers. The spikes are of such short duration that, in spite of their consider- 
able amplitude, they do not cause blocking. The first section includes a 
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twin-triode linear amplifier LAi-LA2 with the two halves in cascade and 
with transformer coupling to input and output. The voltage gain in this 
section, which includes the In and Ic transformers, is some 7,300 times, 
or 77 db. 

The second section uses two oppositely poled silicon diode clippers 
D1 and pb2 which limit both peaks of the spikes before they can reach the 
tuned circuit in the next section. Since the tuned circuit would oscillate, 
it is necessary to limit the sudden voltages which it receives. This appli- 
cation of the silicon diodes utilizes a characteristic that makes them, in 
effect, reverse-biased up to 0.6 volt in the forward direction. The identi- 
fication signal is too low in this stage to be affected by the clippers. The 
adjusting potentiometer GN is just beyond the clippers. With normal 
settings, a loss of about 18 db exists in the second section. 

The third section is another twin-triode amplifier LA3-LA4 working into 
a 5,800-cycle tuned network designated ni. The resistance in this net- 
work is provided to reduce any tendency to oscillate. The voltage gain 
in this section is about 410 times, or 52 db. 

The fourth section, using tube ca, is a class c stage designed to elimi- 
nate signals below the expected minimum operating signal. Since this 
stage is biased beyond cutoff, it ignores signals below the desired level. 
Otherwise, these signals would help build up the grid voltage at the 
output tube and impose a more severe nonoperate condition on the de- 
tector. This stage has a voltage amplification of about 2.6 times, or 9 
db. It has a tuned plate circuit designated Nn2 in Fig. 9. 

The fifth section is a “dipper and bucket counter” comprising a 
double-diode crr and two capacitors. On each negative half-cycle of a 
signal the small capacitor (cTR1) is charged, and on each positive half- 
cycle it spills its charge into a larger bucket capacitor (crr2) which 
therefore gradually increases its voltage in steps until it operates a 
thyratron tube in the sixth section. A resistance is bridged around the 
bucket capacitor to enable the detector to forget comparatively small 
numbers of pulses resulting from random surges. When the detector is 
not testing for a signal, a low-resistance 1,000-ohm circuit is maintained 
across the bucket capacitor. The testing time is controlled by the identi- 
fier, which opens the 1,000-ohm circuit for an interval of 12 to 15 
milliseconds. 

From this description, it can be seen that the amplifier-detector not 
not only has the amplification necessary to raise a 90-microvolt signal 
to a usable value but also discriminates by filtering, by blocking out 
signals known to be spurious because they are too big or too small, and 
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by counting an appropriate number of cycles of legitimate signal before 
being satisfied. 


XI. MAINTENANCE FACILITIES 


In the event of an identification failure or certain other irregularities, 
a trouble record is made. This shows the identity of the various ANI 
circuits involved and the stage to which each had progressed at the time 
the trouble appeared. This record will be recorded by a ticket printer of 
the type used in step-by-step automatic ticketing. After the trouble 
record, a second attempt is made using the other identifier when pro- 
vided. If this attempt should also fail, due to the trouble being in the 
network or somewhere else outside the identifier, no second trial trouble 
record is normally made. This is because the trouble ticketer will be 
busy printing a record of the first failure. If it is desired to take a trouble 
record after second trial instead of first trial failures, a key must be 
operated that is provided for this purpose. Trouble records cannot be 
taken after both first and second trial failures because the functioning 
time of the trouble ticketer is about six seconds, and to wait for it to 
become free would seriously extend the second trial identifier-holding 
time. In the event of a second trial failure, the appropriate information 
digit is sent to cause the CAMA operator to make the identification. A 
special trouble record will be made at tandem and will include the call- 
ing customer’s number as obtained by the operator; this record will be 
returned or reported to the originating office for maintenance use. 
Testing equipment is provided for the ANI trunks, outpulsers, identi- 
fiers and networks, with means for selecting any combination of these 
circuits. Tests are made by selecting the trunks directly rather than 
through the switch train. Normally, the identification signal, instead of 
following the switch train path back to the number networks, is diverted 
to an artificial test network. This facilitates applying marginal tests to 
the detectors to anticipate approaching troubles. It also permits holding 
the test connection while service calls are allowed to use the regular 
number network and bus system. If it is desired to include the regular 
number network system in the test path, a patching connection must be 
made on one of the number network frames to a particular number 
network. In either case, the identified number, instead of being pulsed 
out to tandem, is steered back to the test equipment and displayed on a 
set of lamps. 
When new customers are given service or when line numbers are 
changed, it is important that the corresponding service order work be 
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checked to verify correct identification on calls from these lines. This 
identification is made by the ANI equipment. In No. 1 crossbar and 
step-by-step offices, existing test train facilities are used to direct a test 
call to the line to be verified. In panel offices, this connection. is estab- 
lished by patching at a distributing frame. In all cases, the test connect- 
ing facilities will have access to the ANI outpulsers through the out- 
pulser link. After the line to be verified is reached, the ANI equipment 
is actuated and the outpulser obtains an identification by the normal 
process. Instead of forwarding this number to a distant CAMA office, 
the outpulser will display it on lamps convenient to the observer. 

A new facility will be available in No. 1 crossbar and panel offices for 
identifying lines that have been routed to permanent-signal holding 
trunks because of receiver off-hook or line trouble conditions. Here an 
auxiliary circuit will be provided with access to the outpulsers through 
the outpulser link. To determine the number of a line that has become 
connected to a permanent-signal trunk, the test man will patch the new 
auxiliary circuit to the jack of the permanent-signal trunk. Upon 
receipt of a start signal, the ANI equipment will function and the iden- 
tified number will be displayed on a special ticket produced by the 
trouble ticketer. Since line troubles might or might not give a tip party 
indication if party test were made, the identifier will always test first in 
the ring field on permanent-signal calls. If no identification is made, it 
will then test in the tip field, since the trouble may be on a party line 
with only a tip station connected to the identification buses. It is not 
planned to provide this facility in step-by-step offices because, in the 
absence of any common control equipment, routing of these calls to 
permanent signal holding trunks is not feasible. 


XII. CONCLUSION 


The development of automatic number identification is a major 
advance toward full automation of all customer-dialed calls in the Bell 
System. It provides a simplified procedure for the customers, faster 
service in completing calls and greater accuracy for billing records. 
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